Jun 09 21:45:29.012729 ip-10-0-132-68 systemd[1]: Starting Kubernetes Kubelet... Jun 09 21:45:29.417399 ip-10-0-132-68 kubenswrapper[2560]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 21:45:29.417399 ip-10-0-132-68 kubenswrapper[2560]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 21:45:29.417399 ip-10-0-132-68 kubenswrapper[2560]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 21:45:29.417399 ip-10-0-132-68 kubenswrapper[2560]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 21:45:29.417399 ip-10-0-132-68 kubenswrapper[2560]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 21:45:29.418946 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.418862 2560 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 21:45:29.423133 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423114 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:29.423133 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423131 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:29.423133 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423135 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423140 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423144 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423147 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423150 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423155 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423158 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423161 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423163 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423166 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423168 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423171 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423173 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423175 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423178 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423181 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423184 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423186 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423189 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:29.423257 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423191 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423196 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423199 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423202 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423205 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423207 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423210 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423212 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423214 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423218 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423222 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423225 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423227 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423230 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423233 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423236 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423239 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423242 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423245 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:29.423731 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423248 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423251 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423253 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423256 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423258 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423261 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423263 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423266 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423268 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423271 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423273 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423275 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423278 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423280 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423283 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423285 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423287 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423290 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423292 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:29.424188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423296 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423298 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423301 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423303 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423305 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423308 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423311 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423313 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423316 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423320 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423322 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423325 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423328 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423330 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423347 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423349 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423352 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423354 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423357 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423359 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:29.424668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423362 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423364 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423367 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423369 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423371 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423374 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423376 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423378 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423381 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423383 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423386 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423388 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423390 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423393 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423395 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423398 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423401 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423403 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423405 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.423408 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:29.425703 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424121 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424127 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424130 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424133 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424136 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424139 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424142 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424144 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424147 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424150 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424152 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424155 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424158 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424160 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424163 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424165 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424168 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424171 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424173 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424176 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:29.426221 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424178 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424181 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424183 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424186 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424188 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424191 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424194 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424196 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424199 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424203 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424205 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424208 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424211 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424214 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424217 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424220 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424223 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424225 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424231 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424234 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:29.426739 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424236 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424239 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424241 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424244 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424246 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424248 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424252 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424254 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424257 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424259 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424263 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424267 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424269 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424272 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424274 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424277 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424279 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424282 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424284 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:29.427222 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424287 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424289 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424291 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424294 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424296 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424299 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424302 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424306 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424309 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424312 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424314 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424317 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424321 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424323 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424326 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424329 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424332 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424350 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424353 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424355 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:29.427697 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424358 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424360 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424363 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424366 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424368 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424370 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424373 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424375 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424378 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424380 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424383 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424387 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424391 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424394 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424396 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424399 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424402 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424405 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424409 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:29.428180 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424412 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424777 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424783 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424786 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424789 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424792 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424795 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424798 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424801 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424804 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424808 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424810 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424813 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424816 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424818 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424821 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424823 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424825 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424828 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424830 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:29.428657 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424833 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424835 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424838 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424840 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424843 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424845 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424848 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424850 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424853 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424856 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424859 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424861 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424864 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424866 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424869 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424871 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424874 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424876 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424879 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424882 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:29.429188 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424884 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424887 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424889 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424892 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424894 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424896 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424899 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424901 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424903 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424905 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424908 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424910 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424913 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424915 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424917 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424920 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424922 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424925 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424927 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424930 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:29.429689 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424933 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424935 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424938 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424942 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424944 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424947 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424950 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424953 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424955 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424957 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424960 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424963 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424967 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424970 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424973 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424976 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424978 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424981 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424983 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:29.430169 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424986 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424988 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424991 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424993 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424996 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.424998 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425001 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425003 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425006 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425009 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425012 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425016 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425018 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425025 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425027 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425030 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425033 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425035 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425038 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:29.430637 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425041 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425043 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425122 2560 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425130 2560 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425136 2560 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425141 2560 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425145 2560 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425148 2560 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425152 2560 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425156 2560 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425159 2560 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425162 2560 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425165 2560 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425168 2560 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425171 2560 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425174 2560 flags.go:64] FLAG: --cgroup-root="" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425177 2560 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425180 2560 flags.go:64] FLAG: --client-ca-file="" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425182 2560 flags.go:64] FLAG: --cloud-provider="external" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425185 2560 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425189 2560 flags.go:64] FLAG: --cluster-domain="" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425192 2560 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425195 2560 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425198 2560 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 21:45:29.431101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425202 2560 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425205 2560 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425209 2560 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425213 2560 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425216 2560 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425219 2560 flags.go:64] FLAG: --contention-profiling="false" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425222 2560 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425225 2560 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425228 2560 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425231 2560 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425235 2560 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425238 2560 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425241 2560 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425244 2560 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425247 2560 flags.go:64] FLAG: --enable-server="true" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425250 2560 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425255 2560 flags.go:64] FLAG: --event-burst="100" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425259 2560 flags.go:64] FLAG: --event-qps="50" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425261 2560 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425264 2560 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425267 2560 flags.go:64] FLAG: --eviction-hard="" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425271 2560 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425274 2560 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425277 2560 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425279 2560 flags.go:64] FLAG: --eviction-soft="" Jun 09 21:45:29.431713 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425282 2560 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425285 2560 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425288 2560 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425291 2560 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425293 2560 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425296 2560 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425299 2560 flags.go:64] FLAG: --feature-gates="" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425303 2560 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425305 2560 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425309 2560 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425312 2560 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425315 2560 flags.go:64] FLAG: --healthz-port="10248" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425318 2560 flags.go:64] FLAG: --help="false" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425321 2560 flags.go:64] FLAG: --hostname-override="ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425324 2560 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425327 2560 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425330 2560 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425348 2560 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425352 2560 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425355 2560 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425357 2560 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425360 2560 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425363 2560 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 21:45:29.432309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425366 2560 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425369 2560 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425372 2560 flags.go:64] FLAG: --kube-reserved="" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425375 2560 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425377 2560 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425380 2560 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425383 2560 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425386 2560 flags.go:64] FLAG: --lock-file="" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425388 2560 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425391 2560 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425394 2560 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425399 2560 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425402 2560 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425405 2560 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425408 2560 flags.go:64] FLAG: --logging-format="text" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425410 2560 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425413 2560 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425416 2560 flags.go:64] FLAG: --manifest-url="" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425420 2560 flags.go:64] FLAG: --manifest-url-header="" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425424 2560 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425427 2560 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425431 2560 flags.go:64] FLAG: --max-pods="110" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425434 2560 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425437 2560 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425439 2560 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 21:45:29.432910 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425442 2560 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425445 2560 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425448 2560 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425451 2560 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425460 2560 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425463 2560 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425466 2560 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425469 2560 flags.go:64] FLAG: --pod-cidr="" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425472 2560 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425478 2560 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425481 2560 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425484 2560 flags.go:64] FLAG: --pods-per-core="0" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425487 2560 flags.go:64] FLAG: --port="10250" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425490 2560 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425493 2560 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0522728561909c1a6" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425496 2560 flags.go:64] FLAG: --qos-reserved="" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425499 2560 flags.go:64] FLAG: --read-only-port="10255" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425501 2560 flags.go:64] FLAG: --register-node="true" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425504 2560 flags.go:64] FLAG: --register-with-taints="" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425508 2560 flags.go:64] FLAG: --registry-burst="10" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425512 2560 flags.go:64] FLAG: --registry-qps="5" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425514 2560 flags.go:64] FLAG: --reserved-cpus="" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425517 2560 flags.go:64] FLAG: --reserved-memory="" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425521 2560 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425524 2560 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 21:45:29.433570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425526 2560 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425530 2560 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425533 2560 flags.go:64] FLAG: --runonce="false" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425536 2560 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425539 2560 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425542 2560 flags.go:64] FLAG: --seccomp-default="false" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425544 2560 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425547 2560 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425550 2560 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425553 2560 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425556 2560 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425558 2560 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425561 2560 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425564 2560 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425567 2560 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425570 2560 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425573 2560 flags.go:64] FLAG: --system-cgroups="" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425576 2560 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425581 2560 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425583 2560 flags.go:64] FLAG: --tls-cert-file="" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425586 2560 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425590 2560 flags.go:64] FLAG: --tls-min-version="" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425592 2560 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425595 2560 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425598 2560 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 21:45:29.434158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425601 2560 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425603 2560 flags.go:64] FLAG: --v="2" Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425608 2560 flags.go:64] FLAG: --version="false" Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425612 2560 flags.go:64] FLAG: --vmodule="" Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425615 2560 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.425618 2560 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425728 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425733 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425738 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425742 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425745 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425748 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425751 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425754 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425756 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425759 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425762 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425764 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425767 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425769 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425772 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:29.434809 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425774 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425777 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425779 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425784 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425787 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425790 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425792 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425795 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425798 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425800 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425803 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425805 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425808 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425811 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425814 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425817 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425819 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425822 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425824 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:29.435365 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425828 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425831 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425833 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425836 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425838 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425841 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425844 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425846 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425848 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425852 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425855 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425859 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425861 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425864 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425867 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425870 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425873 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425876 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425879 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425881 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:29.435833 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425883 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425886 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425888 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425890 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425893 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425895 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425899 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425901 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425904 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425906 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425908 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425911 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425915 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425918 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425920 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425923 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425925 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425928 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425930 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425933 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:29.436312 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425935 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425938 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425940 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425943 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425945 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425947 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425950 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425952 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425955 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425957 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425960 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425963 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425965 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425968 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425970 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425973 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425975 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425978 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425982 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:29.436811 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425985 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425988 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425991 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425994 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.425996 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.426000 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.426008 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.432724 2560 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.432832 2560 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.432851 2560 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.432857 2560 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432913 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432918 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432922 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432925 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:29.437284 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432928 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432931 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432934 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432937 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432939 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432942 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432944 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432947 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432950 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432953 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432955 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432958 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432960 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432963 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432966 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432969 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432971 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432974 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432977 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432980 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:29.437779 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432982 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432985 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432987 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432990 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432992 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432995 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.432998 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433000 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433003 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433006 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433008 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433011 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433015 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433018 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433021 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433024 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433027 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433030 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433033 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:29.438274 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433036 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433039 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433043 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433045 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433049 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433052 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433055 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433058 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433061 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433064 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433066 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433068 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433071 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433073 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433077 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433079 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433082 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433084 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433087 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433089 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:29.438737 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433092 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433094 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433097 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433099 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433102 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433104 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433117 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433120 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433123 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433126 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433128 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433131 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433133 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433136 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433138 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433142 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433145 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433148 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433150 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:29.439220 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433153 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433156 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433158 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433162 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433165 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433167 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433170 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433172 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433175 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433177 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433179 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433182 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433185 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433187 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433190 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433192 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:29.439736 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433195 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.433200 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433314 2560 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433319 2560 feature_gate.go:328] unrecognized feature gate: Example Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433322 2560 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433325 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433328 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433330 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433346 2560 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433350 2560 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433352 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433355 2560 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433358 2560 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433361 2560 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433363 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 21:45:29.440445 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433366 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433369 2560 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433372 2560 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433374 2560 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433377 2560 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433379 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433382 2560 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433385 2560 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433387 2560 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433390 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433393 2560 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433395 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433398 2560 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433400 2560 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433403 2560 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433405 2560 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433408 2560 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433410 2560 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433412 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433415 2560 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 21:45:29.440976 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433417 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433420 2560 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433422 2560 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433424 2560 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433427 2560 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433429 2560 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433432 2560 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433434 2560 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433436 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433440 2560 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433443 2560 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433446 2560 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433449 2560 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433452 2560 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433454 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433457 2560 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433459 2560 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433462 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433464 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433467 2560 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 21:45:29.441526 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433469 2560 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433472 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433474 2560 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433477 2560 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433479 2560 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433482 2560 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433484 2560 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433487 2560 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433490 2560 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433492 2560 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433495 2560 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433499 2560 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433501 2560 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433504 2560 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433506 2560 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433508 2560 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433511 2560 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433513 2560 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433516 2560 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433518 2560 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 21:45:29.442013 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433520 2560 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433523 2560 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433525 2560 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433528 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433531 2560 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433534 2560 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433538 2560 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433540 2560 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433544 2560 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433546 2560 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433549 2560 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433551 2560 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433554 2560 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433556 2560 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433559 2560 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433562 2560 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433564 2560 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433566 2560 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433569 2560 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 21:45:29.442501 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433571 2560 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433574 2560 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433576 2560 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433579 2560 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433581 2560 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433584 2560 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:29.433587 2560 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.433592 2560 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.433694 2560 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.435588 2560 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.436901 2560 server.go:1019] "Starting client certificate rotation" Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.437011 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.437051 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 21:45:29.442960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.439049 2560 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 21:45:29.445201 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.445178 2560 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 21:45:29.455664 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.455646 2560 log.go:25] "Validated CRI v1 runtime API" Jun 09 21:45:29.459660 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.459642 2560 log.go:25] "Validated CRI v1 image API" Jun 09 21:45:29.460471 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.460438 2560 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 21:45:29.465251 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.465222 2560 fs.go:135] Filesystem UUIDs: map[1da42198-1ff6-4ea9-bee7-34a0fdba499d:/dev/nvme0n1p4 6c28e708-f99e-4d15-859e-99293161db11:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 09 21:45:29.465364 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.465249 2560 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 21:45:29.470290 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.470161 2560 manager.go:216] Machine: {Timestamp:2026-06-09 21:45:29.468980731 +0000 UTC m=+0.333240223 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097179 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b9b8abef5dae598b6b6f176387995 SystemUUID:ec2b9b8a-bef5-dae5-98b6-b6f176387995 BootID:eb84c201-fcc9-44ed-bd84-6098112dc78f Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4a:4d:f4:77:ad Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4a:4d:f4:77:ad Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:a4:65:db:b8:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 21:45:29.470290 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.470282 2560 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 21:45:29.470471 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.470309 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 21:45:29.470471 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.470456 2560 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 21:45:29.473627 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.473596 2560 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 21:45:29.473795 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.473630 2560 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 21:45:29.474282 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.474270 2560 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 21:45:29.474351 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.474288 2560 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 21:45:29.474351 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.474305 2560 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 21:45:29.475070 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.475057 2560 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 21:45:29.475741 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.475729 2560 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 21:45:29.478906 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.478892 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 09 21:45:29.479038 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479026 2560 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 21:45:29.479098 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479066 2560 kubelet.go:486] "Attempting to sync node with API server" Jun 09 21:45:29.479098 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479082 2560 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 21:45:29.479188 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479102 2560 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 21:45:29.479188 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479116 2560 kubelet.go:398] "Adding apiserver pod source" Jun 09 21:45:29.479188 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479129 2560 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 21:45:29.479525 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479511 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 21:45:29.479602 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.479533 2560 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 21:45:29.481992 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.481975 2560 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 21:45:29.483838 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.483822 2560 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 21:45:29.483918 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.483860 2560 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 21:45:29.485065 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485042 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 21:45:29.485065 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485065 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485074 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485082 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485092 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485097 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485115 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485122 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485128 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485134 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485147 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 21:45:29.485186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.485153 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 21:45:29.486157 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.486137 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 21:45:29.488019 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.487998 2560 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 21:45:29.489809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.489790 2560 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 21:45:29.489893 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.489865 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 21:45:29.490304 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.490280 2560 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 21:45:29.491585 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.491569 2560 server.go:1268] "Started kubelet" Jun 09 21:45:29.491692 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.491644 2560 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 21:45:29.491847 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.491804 2560 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 21:45:29.491931 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.491866 2560 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 21:45:29.492118 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.492096 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xctdj" Jun 09 21:45:29.492503 ip-10-0-132-68 systemd[1]: Started Kubernetes Kubelet. Jun 09 21:45:29.494681 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.494662 2560 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 21:45:29.494884 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.494869 2560 server.go:310] "Adding debug handlers to kubelet server" Jun 09 21:45:29.497049 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.497029 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xctdj" Jun 09 21:45:29.498801 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.498782 2560 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 21:45:29.498864 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.497706 2560 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-68.ec2.internal.18b787d5af8f9cee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-68.ec2.internal,UID:ip-10-0-132-68.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-68.ec2.internal,},FirstTimestamp:2026-06-09 21:45:29.491528942 +0000 UTC m=+0.355788433,LastTimestamp:2026-06-09 21:45:29.491528942 +0000 UTC m=+0.355788433,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-68.ec2.internal,}" Jun 09 21:45:29.499081 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.499062 2560 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 21:45:29.499081 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.499072 2560 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 21:45:29.499220 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.499164 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:29.500237 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.499679 2560 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 21:45:29.500392 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.500360 2560 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 21:45:29.500392 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.500377 2560 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 21:45:29.500580 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.500518 2560 reconstruct.go:97] "Volume reconstruction finished" Jun 09 21:45:29.500580 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.500531 2560 reconciler.go:29] "Reconciler: start to sync state" Jun 09 21:45:29.501450 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.501425 2560 factory.go:55] Registering systemd factory Jun 09 21:45:29.501515 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.501467 2560 factory.go:223] Registration of the systemd container factory successfully Jun 09 21:45:29.501899 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.501873 2560 factory.go:153] Registering CRI-O factory Jun 09 21:45:29.501899 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.501889 2560 factory.go:223] Registration of the crio container factory successfully Jun 09 21:45:29.502032 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.501937 2560 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 21:45:29.502032 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.501964 2560 factory.go:103] Registering Raw factory Jun 09 21:45:29.502032 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.501986 2560 manager.go:1196] Started watching for new ooms in manager Jun 09 21:45:29.502431 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.502418 2560 manager.go:349] Starting recovery of all containers Jun 09 21:45:29.510908 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.510888 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:29.512032 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.512018 2560 manager.go:354] Recovery completed Jun 09 21:45:29.513946 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.513917 2560 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-68.ec2.internal\" not found" node="ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.517286 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.517273 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:29.520209 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.520193 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:29.520306 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.520226 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:29.520306 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.520241 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:29.520797 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.520785 2560 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 21:45:29.520797 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.520797 2560 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 21:45:29.520863 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.520813 2560 state_mem.go:36] "Initialized new in-memory state store" Jun 09 21:45:29.520863 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.520832 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:29.521626 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.521608 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:29.521705 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.521642 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:29.521705 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.521657 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:29.522002 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.521989 2560 policy_none.go:49] "None policy: Start" Jun 09 21:45:29.522048 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.522005 2560 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 21:45:29.522048 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.522015 2560 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 21:45:29.522849 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.522838 2560 policy_none.go:47] "Start" Jun 09 21:45:29.565013 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.564996 2560 manager.go:337] "Starting Device Plugin manager" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.565063 2560 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.565073 2560 server.go:87] "Starting device plugin registration server" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.565371 2560 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.565382 2560 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.565477 2560 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.565581 2560 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.565591 2560 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.566612 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.567355 2560 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.567405 2560 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.568006 2560 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.568062 2560 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.568088 2560 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.568175 2560 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 21:45:29.570882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.569970 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:29.666484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.666455 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:29.667513 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.667461 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:29.667513 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.667496 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:29.667513 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.667507 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:29.667663 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.667529 2560 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.668571 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.668553 2560 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal"] Jun 09 21:45:29.668638 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.668625 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:29.670077 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.670063 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:29.670167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.670094 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:29.670167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.670109 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:29.672077 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672062 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:29.672204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672177 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.672257 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672217 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:29.672768 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672754 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:29.672768 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672765 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:29.672865 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672780 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:29.672865 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672789 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:29.672865 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672789 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:29.672948 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.672878 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:29.674550 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.674535 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.674617 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.674566 2560 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 21:45:29.675200 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.675185 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientMemory" Jun 09 21:45:29.675276 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.675209 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 21:45:29.675276 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.675223 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeHasSufficientPID" Jun 09 21:45:29.675393 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.675368 2560 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.675393 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.675384 2560 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-68.ec2.internal\": node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:29.688365 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.688327 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:29.701116 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.701084 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-68.ec2.internal\" not found" node="ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.702177 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.702162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/109ea32a4fdb0c8b20767f315039b272-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"109ea32a4fdb0c8b20767f315039b272\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.702238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.702185 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/109ea32a4fdb0c8b20767f315039b272-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"109ea32a4fdb0c8b20767f315039b272\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.702238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.702204 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1184e068451611d3df0e645620bcf5d7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-68.ec2.internal\" (UID: \"1184e068451611d3df0e645620bcf5d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.704661 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.704645 2560 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-68.ec2.internal\" not found" node="ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.788638 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.788600 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:29.803021 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.802996 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/109ea32a4fdb0c8b20767f315039b272-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"109ea32a4fdb0c8b20767f315039b272\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.803120 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.803027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1184e068451611d3df0e645620bcf5d7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-68.ec2.internal\" (UID: \"1184e068451611d3df0e645620bcf5d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.803120 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.803047 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/109ea32a4fdb0c8b20767f315039b272-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"109ea32a4fdb0c8b20767f315039b272\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.803120 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.803096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/109ea32a4fdb0c8b20767f315039b272-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"109ea32a4fdb0c8b20767f315039b272\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.803238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.803096 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/109ea32a4fdb0c8b20767f315039b272-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal\" (UID: \"109ea32a4fdb0c8b20767f315039b272\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.803238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:29.803134 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1184e068451611d3df0e645620bcf5d7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-68.ec2.internal\" (UID: \"1184e068451611d3df0e645620bcf5d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jun 09 21:45:29.889199 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.889153 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:29.989987 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:29.989923 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:30.006397 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.006368 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:30.011188 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.010950 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jun 09 21:45:30.090305 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:30.090264 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:30.190855 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:30.190827 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:30.291451 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:30.291351 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:30.362117 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.362083 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:30.392306 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:30.392277 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:30.436848 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.436816 2560 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 21:45:30.437494 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.436990 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 21:45:30.437494 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.437004 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 21:45:30.437494 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.436993 2560 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 21:45:30.493237 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:30.493206 2560 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-68.ec2.internal\" not found" Jun 09 21:45:30.499906 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.499882 2560 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:30.503736 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.502103 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 21:40:29 +0000 UTC" deadline="2028-03-23 15:21:03.773543154 +0000 UTC" Jun 09 21:45:30.503736 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.502166 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15665h35m33.271381372s" Jun 09 21:45:30.594385 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.594217 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 21:45:30.600010 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.599992 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" Jun 09 21:45:30.609434 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.609416 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 21:45:30.610668 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.610653 2560 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" Jun 09 21:45:30.618113 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:30.618095 2560 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 21:45:31.480777 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.480742 2560 apiserver.go:52] "Watching apiserver" Jun 09 21:45:31.491607 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.491576 2560 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 21:45:31.492047 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.492001 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-tlzm9","kube-system/konnectivity-agent-9mlsc","kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn","openshift-dns/node-resolver-64jmm","openshift-multus/multus-additional-cni-plugins-wzst2","openshift-multus/network-metrics-daemon-f5fx7","openshift-network-diagnostics/network-check-target-cxd5q","openshift-ovn-kubernetes/ovnkube-node-gfwh8","kube-system/global-pull-secret-syncer-5dcbz","openshift-cluster-node-tuning-operator/tuned-njdfb","openshift-image-registry/node-ca-7hdcz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal","openshift-multus/multus-btmvp"] Jun 09 21:45:31.495072 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.495051 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:31.495176 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.495133 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:31.496913 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.496889 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.499014 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.498991 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:45:31.499108 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.499022 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-z4rzd\"" Jun 09 21:45:31.499108 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.499054 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 21:45:31.499417 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.499401 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.500147 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.499653 2560 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 21:45:31.501400 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.501380 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 21:45:31.501516 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.501484 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 21:45:31.501628 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.501618 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 21:45:31.501693 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.501621 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 21:45:31.501693 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.501675 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5ffvk\"" Jun 09 21:45:31.502061 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.502043 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.504403 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.504381 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.507298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.506879 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c2p9w\"" Jun 09 21:45:31.507298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.506936 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 21:45:31.507298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.506880 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 21:45:31.507298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.506938 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 21:45:31.507298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.507175 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 21:45:31.507298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.507205 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 21:45:31.507298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.507270 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-786ch\"" Jun 09 21:45:31.508296 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.508273 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.510111 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.510092 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 21:45:31.510448 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.510428 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 21:45:31.510541 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.510501 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwzx5\"" Jun 09 21:45:31.510731 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.510712 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.511654 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511634 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-socket-dir-parent\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511664 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-cni-multus\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511690 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-conf-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511711 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n924d\" (UniqueName: \"kubernetes.io/projected/3ba240dd-5ec9-400d-8f30-4dc173075a7d-kube-api-access-n924d\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511737 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-cni-bin\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511760 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-tuned\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.511926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511785 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-cni-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-cnibin\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511836 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.511926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511860 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swl9q\" (UniqueName: \"kubernetes.io/projected/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-kube-api-access-swl9q\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.511926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511884 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-netns\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.511926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511908 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511931 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-lib-modules\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511950 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn5qb\" (UniqueName: \"kubernetes.io/projected/31639916-2d52-47e4-90b9-a15c87a3c7f8-kube-api-access-cn5qb\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511965 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-daemon-config\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.511981 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-device-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512000 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-host\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512014 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-system-cni-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512026 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-os-release\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-kubelet\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512075 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-sys-fs\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-var-lib-kubelet\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512183 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-modprobe-d\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512220 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysconfig\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512247 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysctl-conf\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512273 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ba240dd-5ec9-400d-8f30-4dc173075a7d-cni-binary-copy\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512295 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-hostroot\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512324 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-etc-kubernetes\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512400 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jgfl\" (UniqueName: \"kubernetes.io/projected/b9d90437-5a29-4e28-b396-61a3c8df3d57-kube-api-access-5jgfl\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512436 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-kubernetes\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512457 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-run\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512479 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-sys\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512500 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-k8s-cni-cncf-io\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512522 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-registration-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512567 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-systemd\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512598 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31639916-2d52-47e4-90b9-a15c87a3c7f8-tmp\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512628 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-multus-certs\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512651 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-socket-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512686 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysctl-d\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512713 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 21:45:31.512860 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512714 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 21:45:31.513601 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.512977 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 21:45:31.513601 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.513186 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:31.513601 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.513268 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:31.514836 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.514817 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 21:45:31.514915 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.514840 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 21:45:31.515156 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.515129 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 21:45:31.515366 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.515330 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nmvv7\"" Jun 09 21:45:31.515574 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.515555 2560 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 21:45:31.516757 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.516739 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.518885 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.518871 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f2btc\"" Jun 09 21:45:31.519508 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.518927 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 21:45:31.519614 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.519209 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 21:45:31.519614 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.519458 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.519726 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.519639 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:31.521585 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.521563 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.523642 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.523622 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:45:31.523951 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.523934 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.524044 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.523956 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 21:45:31.524044 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.523982 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 21:45:31.524157 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.524040 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9s5g5\"" Jun 09 21:45:31.526362 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.526142 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 21:45:31.527807 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.527780 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 21:45:31.527807 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.527795 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 21:45:31.528076 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.528057 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmm84\"" Jun 09 21:45:31.531269 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.531250 2560 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x2n78" Jun 09 21:45:31.537697 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.537673 2560 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x2n78" Jun 09 21:45:31.573812 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.573756 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" event={"ID":"109ea32a4fdb0c8b20767f315039b272","Type":"ContainerStarted","Data":"9669768061d1e24f695a0fd511bd6e632837906e4f7d313804076ac7426e18b5"} Jun 09 21:45:31.574960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.574936 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" event={"ID":"1184e068451611d3df0e645620bcf5d7","Type":"ContainerStarted","Data":"e3a2941e1aa4712c5b0270f6942da5662b9e1495d10ffe56d2d50715bc36c141"} Jun 09 21:45:31.601485 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.601456 2560 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 21:45:31.612916 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.612882 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0390187-24cc-4edb-88ee-be4e2acebaba-serviceca\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.612916 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.612911 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.613128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.612934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-systemd-units\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.613128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.612957 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-slash\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.613128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.612995 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-modprobe-d\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ba240dd-5ec9-400d-8f30-4dc173075a7d-cni-binary-copy\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.613128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613098 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-hostroot\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.613128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613118 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613140 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-kubelet\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-os-release\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-modprobe-d\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613187 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-kubernetes\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613202 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-hostroot\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-run\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613252 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-run\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613268 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-sys\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613280 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-kubernetes\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-k8s-cni-cncf-io\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613333 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613366 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-k8s-cni-cncf-io\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613375 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-registration-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613386 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-sys\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613402 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613403 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-ovn\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.613421 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613430 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-systemd\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613445 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-multus-certs\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613447 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-registration-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-node-log\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613476 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-run-ovn-kubernetes\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613506 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-systemd\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613518 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-multus-certs\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovnkube-script-lib\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613557 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysctl-d\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613578 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-cni-multus\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613603 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n924d\" (UniqueName: \"kubernetes.io/projected/3ba240dd-5ec9-400d-8f30-4dc173075a7d-kube-api-access-n924d\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613640 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-cni-multus\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613687 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0390187-24cc-4edb-88ee-be4e2acebaba-host\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613691 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysctl-d\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613713 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-tmp-dir\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613742 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613748 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ba240dd-5ec9-400d-8f30-4dc173075a7d-cni-binary-copy\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614202 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613769 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-tuned\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613839 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-cni-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613916 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cxcl\" (UniqueName: \"kubernetes.io/projected/e0390187-24cc-4edb-88ee-be4e2acebaba-kube-api-access-6cxcl\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613939 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-cni-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613936 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-env-overrides\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613995 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.613995 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2wn8\" (UniqueName: \"kubernetes.io/projected/f9ed08f8-145e-4095-b61a-cb7cdef73032-kube-api-access-b2wn8\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614043 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-hosts-file\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614062 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-netns\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614082 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614106 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-daemon-config\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614129 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-sys-fs\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614129 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-run-netns\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614155 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614201 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-host\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614224 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-system-cni-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.614238 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:31.614894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614253 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-run-netns\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614275 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-var-lib-kubelet\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.614307 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:32.114286785 +0000 UTC m=+2.978546281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614323 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4517fb82-81a2-4b3c-b6a6-7b3ab22aac70-konnectivity-ca\") pod \"konnectivity-agent-9mlsc\" (UID: \"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70\") " pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614359 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-var-lib-kubelet\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614370 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfh4s\" (UniqueName: \"kubernetes.io/projected/32968818-8e4b-488a-921f-2216beb2c693-kube-api-access-jfh4s\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614385 2560 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614409 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-host\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614413 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysconfig\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614439 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysctl-conf\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614454 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-system-cni-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-etc-kubernetes\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614501 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovn-node-metrics-cert\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614524 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-sys-fs\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614549 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-cnibin\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614573 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jgfl\" (UniqueName: \"kubernetes.io/projected/b9d90437-5a29-4e28-b396-61a3c8df3d57-kube-api-access-5jgfl\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:31.615644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614594 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-etc-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614617 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovnkube-config\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614642 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-kubelet-config\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614673 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-etc-kubernetes\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614675 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614732 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysconfig\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614851 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-sysctl-conf\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614902 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31639916-2d52-47e4-90b9-a15c87a3c7f8-tmp\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-socket-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.614984 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-cni-netd\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615011 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615045 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-socket-dir-parent\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615065 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-conf-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615081 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acc53ab8-c796-4930-9e99-951bf3b0122c-iptables-alerter-script\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615096 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-systemd\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615120 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-dbus\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615138 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-daemon-config\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615142 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4xkk\" (UniqueName: \"kubernetes.io/projected/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-kube-api-access-b4xkk\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615178 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-system-cni-dir\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615214 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615227 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-socket-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615233 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-cni-bin\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615250 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-cnibin\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615265 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swl9q\" (UniqueName: \"kubernetes.io/projected/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-kube-api-access-swl9q\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615272 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-socket-dir-parent\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615317 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-var-lib-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615357 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-lib-modules\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn5qb\" (UniqueName: \"kubernetes.io/projected/31639916-2d52-47e4-90b9-a15c87a3c7f8-kube-api-access-cn5qb\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615436 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-device-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615460 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc53ab8-c796-4930-9e99-951bf3b0122c-host-slash\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615484 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-cni-bin\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615512 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-os-release\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615742 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-cnibin\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.616800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615748 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-kubelet\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615784 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-kubelet\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615788 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc7qp\" (UniqueName: \"kubernetes.io/projected/acc53ab8-c796-4930-9e99-951bf3b0122c-kube-api-access-jc7qp\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615817 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-log-socket\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615842 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-os-release\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4517fb82-81a2-4b3c-b6a6-7b3ab22aac70-agent-certs\") pod \"konnectivity-agent-9mlsc\" (UID: \"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70\") " pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.615921 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/31639916-2d52-47e4-90b9-a15c87a3c7f8-lib-modules\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.616114 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-device-dir\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.616185 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-multus-conf-dir\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.617468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.616186 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ba240dd-5ec9-400d-8f30-4dc173075a7d-host-var-lib-cni-bin\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.617978 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.617959 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31639916-2d52-47e4-90b9-a15c87a3c7f8-tmp\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.618039 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.617984 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/31639916-2d52-47e4-90b9-a15c87a3c7f8-etc-tuned\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.621280 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.621219 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n924d\" (UniqueName: \"kubernetes.io/projected/3ba240dd-5ec9-400d-8f30-4dc173075a7d-kube-api-access-n924d\") pod \"multus-btmvp\" (UID: \"3ba240dd-5ec9-400d-8f30-4dc173075a7d\") " pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.626128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.626102 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swl9q\" (UniqueName: \"kubernetes.io/projected/a79bcbd4-fde3-4606-a6b9-61d44da6b1b3-kube-api-access-swl9q\") pod \"aws-ebs-csi-driver-node-lgssn\" (UID: \"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.626819 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.626793 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jgfl\" (UniqueName: \"kubernetes.io/projected/b9d90437-5a29-4e28-b396-61a3c8df3d57-kube-api-access-5jgfl\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:31.626925 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.626910 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn5qb\" (UniqueName: \"kubernetes.io/projected/31639916-2d52-47e4-90b9-a15c87a3c7f8-kube-api-access-cn5qb\") pod \"tuned-njdfb\" (UID: \"31639916-2d52-47e4-90b9-a15c87a3c7f8\") " pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.716369 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716318 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-ovn\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-node-log\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716407 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-run-ovn-kubernetes\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716427 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovnkube-script-lib\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-ovn\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0390187-24cc-4edb-88ee-be4e2acebaba-host\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716493 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0390187-24cc-4edb-88ee-be4e2acebaba-host\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716495 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-tmp-dir\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716508 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-run-ovn-kubernetes\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716526 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-node-log\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.716551 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716530 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716585 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxcl\" (UniqueName: \"kubernetes.io/projected/e0390187-24cc-4edb-88ee-be4e2acebaba-kube-api-access-6cxcl\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716617 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-env-overrides\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716651 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2wn8\" (UniqueName: \"kubernetes.io/projected/f9ed08f8-145e-4095-b61a-cb7cdef73032-kube-api-access-b2wn8\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716675 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-hosts-file\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716718 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716746 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-run-netns\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716768 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-tmp-dir\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716770 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4517fb82-81a2-4b3c-b6a6-7b3ab22aac70-konnectivity-ca\") pod \"konnectivity-agent-9mlsc\" (UID: \"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70\") " pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716796 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfh4s\" (UniqueName: \"kubernetes.io/projected/32968818-8e4b-488a-921f-2216beb2c693-kube-api-access-jfh4s\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716827 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovn-node-metrics-cert\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716851 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-cnibin\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716876 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-etc-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovnkube-config\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716945 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716956 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-kubelet-config\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.716986 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717020 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-cni-netd\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovnkube-script-lib\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717087 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acc53ab8-c796-4930-9e99-951bf3b0122c-iptables-alerter-script\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-systemd\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717135 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-dbus\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717142 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717149 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-run-netns\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4xkk\" (UniqueName: \"kubernetes.io/projected/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-kube-api-access-b4xkk\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717185 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-system-cni-dir\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717210 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717239 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-var-lib-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717263 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717292 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc53ab8-c796-4930-9e99-951bf3b0122c-host-slash\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717315 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-cni-bin\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-env-overrides\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717366 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc7qp\" (UniqueName: \"kubernetes.io/projected/acc53ab8-c796-4930-9e99-951bf3b0122c-kube-api-access-jc7qp\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.717940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717402 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-log-socket\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4517fb82-81a2-4b3c-b6a6-7b3ab22aac70-agent-certs\") pod \"konnectivity-agent-9mlsc\" (UID: \"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70\") " pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717450 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0390187-24cc-4edb-88ee-be4e2acebaba-serviceca\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717488 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-cnibin\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717504 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-systemd-units\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717530 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-slash\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717587 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-kubelet\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-os-release\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717604 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4517fb82-81a2-4b3c-b6a6-7b3ab22aac70-konnectivity-ca\") pod \"konnectivity-agent-9mlsc\" (UID: \"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70\") " pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717623 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-cni-netd\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717114 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-hosts-file\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717443 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-etc-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717691 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-var-lib-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717701 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-openvswitch\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717714 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-dbus\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717746 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-cni-bin\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.718698 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.717778 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.717878 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret podName:c55a97ee-309d-40d3-a822-ef9bbcf3f94e nodeName:}" failed. No retries permitted until 2026-06-09 21:45:32.217858457 +0000 UTC m=+3.082117938 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret") pod "global-pull-secret-syncer-5dcbz" (UID: "c55a97ee-309d-40d3-a822-ef9bbcf3f94e") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717937 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0390187-24cc-4edb-88ee-be4e2acebaba-serviceca\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717957 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-kubelet-config\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.717988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-system-cni-dir\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718036 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/acc53ab8-c796-4930-9e99-951bf3b0122c-host-slash\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718046 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-log-socket\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718163 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovnkube-config\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718241 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718264 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-slash\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718307 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-systemd-units\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718307 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718377 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-host-kubelet\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32968818-8e4b-488a-921f-2216beb2c693-os-release\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718505 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f9ed08f8-145e-4095-b61a-cb7cdef73032-run-systemd\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718525 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/acc53ab8-c796-4930-9e99-951bf3b0122c-iptables-alerter-script\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.719408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.718732 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32968818-8e4b-488a-921f-2216beb2c693-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.720525 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.720500 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4517fb82-81a2-4b3c-b6a6-7b3ab22aac70-agent-certs\") pod \"konnectivity-agent-9mlsc\" (UID: \"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70\") " pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.720636 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.720601 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f9ed08f8-145e-4095-b61a-cb7cdef73032-ovn-node-metrics-cert\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.725388 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.725190 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfh4s\" (UniqueName: \"kubernetes.io/projected/32968818-8e4b-488a-921f-2216beb2c693-kube-api-access-jfh4s\") pod \"multus-additional-cni-plugins-wzst2\" (UID: \"32968818-8e4b-488a-921f-2216beb2c693\") " pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.725388 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.725323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cxcl\" (UniqueName: \"kubernetes.io/projected/e0390187-24cc-4edb-88ee-be4e2acebaba-kube-api-access-6cxcl\") pod \"node-ca-7hdcz\" (UID: \"e0390187-24cc-4edb-88ee-be4e2acebaba\") " pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:31.725840 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.725818 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:31.725918 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.725851 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:31.725918 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.725867 2560 projected.go:196] Error preparing data for projected volume kube-api-access-k95vk for pod openshift-network-diagnostics/network-check-target-cxd5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:31.726019 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:31.725948 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk podName:c26132ce-b22c-46e5-bf68-f531aac4c5c0 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:32.2259286 +0000 UTC m=+3.090188099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k95vk" (UniqueName: "kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk") pod "network-check-target-cxd5q" (UID: "c26132ce-b22c-46e5-bf68-f531aac4c5c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:31.727930 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.727902 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4xkk\" (UniqueName: \"kubernetes.io/projected/12f9b2cc-1ce0-44fb-94ee-53043fe84a28-kube-api-access-b4xkk\") pod \"node-resolver-64jmm\" (UID: \"12f9b2cc-1ce0-44fb-94ee-53043fe84a28\") " pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.728354 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.728311 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2wn8\" (UniqueName: \"kubernetes.io/projected/f9ed08f8-145e-4095-b61a-cb7cdef73032-kube-api-access-b2wn8\") pod \"ovnkube-node-gfwh8\" (UID: \"f9ed08f8-145e-4095-b61a-cb7cdef73032\") " pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.728806 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.728787 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc7qp\" (UniqueName: \"kubernetes.io/projected/acc53ab8-c796-4930-9e99-951bf3b0122c-kube-api-access-jc7qp\") pod \"iptables-alerter-tlzm9\" (UID: \"acc53ab8-c796-4930-9e99-951bf3b0122c\") " pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.738191 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.738089 2560 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:31.810212 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.810177 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-njdfb" Jun 09 21:45:31.818462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.818439 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-btmvp" Jun 09 21:45:31.829488 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.829466 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:31.834419 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.834396 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" Jun 09 21:45:31.841077 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.841052 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-64jmm" Jun 09 21:45:31.847660 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.847641 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzst2" Jun 09 21:45:31.855459 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.855436 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:31.863912 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.863893 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tlzm9" Jun 09 21:45:31.868470 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:31.868444 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7hdcz" Jun 09 21:45:32.030425 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.030353 2560 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:32.120629 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.120598 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:32.120810 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.120758 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:32.120873 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.120827 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:33.120807586 +0000 UTC m=+3.985067066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:32.221730 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.221692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:32.221893 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.221827 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:32.221893 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.221894 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret podName:c55a97ee-309d-40d3-a822-ef9bbcf3f94e nodeName:}" failed. No retries permitted until 2026-06-09 21:45:33.221877143 +0000 UTC m=+4.086136640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret") pod "global-pull-secret-syncer-5dcbz" (UID: "c55a97ee-309d-40d3-a822-ef9bbcf3f94e") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:32.322070 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.321984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:32.322225 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.322171 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:32.322225 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.322191 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:32.322225 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.322202 2560 projected.go:196] Error preparing data for projected volume kube-api-access-k95vk for pod openshift-network-diagnostics/network-check-target-cxd5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:32.322406 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.322243 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk podName:c26132ce-b22c-46e5-bf68-f531aac4c5c0 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:33.322230461 +0000 UTC m=+4.186489939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k95vk" (UniqueName: "kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk") pod "network-check-target-cxd5q" (UID: "c26132ce-b22c-46e5-bf68-f531aac4c5c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:32.456747 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.456706 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc53ab8_c796_4930_9e99_951bf3b0122c.slice/crio-39cbc687fd96c1e90fbd9da0daff3bb9513f03b3873f787b3d8b0128f7904cf5 WatchSource:0}: Error finding container 39cbc687fd96c1e90fbd9da0daff3bb9513f03b3873f787b3d8b0128f7904cf5: Status 404 returned error can't find the container with id 39cbc687fd96c1e90fbd9da0daff3bb9513f03b3873f787b3d8b0128f7904cf5 Jun 09 21:45:32.476119 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.476092 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba240dd_5ec9_400d_8f30_4dc173075a7d.slice/crio-29cd0b9c1d501bfa0d315246f1d597424ecd79d99f340039d63f88e5ac7ea982 WatchSource:0}: Error finding container 29cd0b9c1d501bfa0d315246f1d597424ecd79d99f340039d63f88e5ac7ea982: Status 404 returned error can't find the container with id 29cd0b9c1d501bfa0d315246f1d597424ecd79d99f340039d63f88e5ac7ea982 Jun 09 21:45:32.477949 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.477802 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f9b2cc_1ce0_44fb_94ee_53043fe84a28.slice/crio-dc09ffb6bb935262b9e9846466b5a63dc15c9bf589d5420209607ebe4f6f90d6 WatchSource:0}: Error finding container dc09ffb6bb935262b9e9846466b5a63dc15c9bf589d5420209607ebe4f6f90d6: Status 404 returned error can't find the container with id dc09ffb6bb935262b9e9846466b5a63dc15c9bf589d5420209607ebe4f6f90d6 Jun 09 21:45:32.481003 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.480961 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4517fb82_81a2_4b3c_b6a6_7b3ab22aac70.slice/crio-5a0037160cc3b9001799b3639d10c395130439772ed4e334d3cfb94d823f5960 WatchSource:0}: Error finding container 5a0037160cc3b9001799b3639d10c395130439772ed4e334d3cfb94d823f5960: Status 404 returned error can't find the container with id 5a0037160cc3b9001799b3639d10c395130439772ed4e334d3cfb94d823f5960 Jun 09 21:45:32.481744 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.481720 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31639916_2d52_47e4_90b9_a15c87a3c7f8.slice/crio-cc487d51deb28043ad6ae5b548b12c6492d2199f60797b16aa4894fd321dd6a9 WatchSource:0}: Error finding container cc487d51deb28043ad6ae5b548b12c6492d2199f60797b16aa4894fd321dd6a9: Status 404 returned error can't find the container with id cc487d51deb28043ad6ae5b548b12c6492d2199f60797b16aa4894fd321dd6a9 Jun 09 21:45:32.483143 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.483119 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32968818_8e4b_488a_921f_2216beb2c693.slice/crio-488d5e3bb3c8ad0915d03b19dfc8b9a984a6962de98c3c113350df4707f1f9b5 WatchSource:0}: Error finding container 488d5e3bb3c8ad0915d03b19dfc8b9a984a6962de98c3c113350df4707f1f9b5: Status 404 returned error can't find the container with id 488d5e3bb3c8ad0915d03b19dfc8b9a984a6962de98c3c113350df4707f1f9b5 Jun 09 21:45:32.485233 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.485208 2560 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 21:45:32.485602 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.485549 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0390187_24cc_4edb_88ee_be4e2acebaba.slice/crio-68ac5e1662c93d0b728d453d551a8f7db2696e035b471bf1ba7ce1d57cefb641 WatchSource:0}: Error finding container 68ac5e1662c93d0b728d453d551a8f7db2696e035b471bf1ba7ce1d57cefb641: Status 404 returned error can't find the container with id 68ac5e1662c93d0b728d453d551a8f7db2696e035b471bf1ba7ce1d57cefb641 Jun 09 21:45:32.486516 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:45:32.486494 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79bcbd4_fde3_4606_a6b9_61d44da6b1b3.slice/crio-73bc534c07d04f802d8bccf3f0f4286ab3fb2dd8abede2661ec8af42c0a61974 WatchSource:0}: Error finding container 73bc534c07d04f802d8bccf3f0f4286ab3fb2dd8abede2661ec8af42c0a61974: Status 404 returned error can't find the container with id 73bc534c07d04f802d8bccf3f0f4286ab3fb2dd8abede2661ec8af42c0a61974 Jun 09 21:45:32.541075 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.541033 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 21:40:31 +0000 UTC" deadline="2027-11-06 06:18:13.14392488 +0000 UTC" Jun 09 21:45:32.541075 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.541073 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12344h32m40.602854014s" Jun 09 21:45:32.568695 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.568638 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:32.568786 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:32.568761 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:32.578239 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.578179 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"477230f4de450394b506157c56e4e3d2e93084195d7eef8ba065bcb5041d6e70"} Jun 09 21:45:32.579525 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.579495 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-njdfb" event={"ID":"31639916-2d52-47e4-90b9-a15c87a3c7f8","Type":"ContainerStarted","Data":"cc487d51deb28043ad6ae5b548b12c6492d2199f60797b16aa4894fd321dd6a9"} Jun 09 21:45:32.583984 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.583958 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" event={"ID":"1184e068451611d3df0e645620bcf5d7","Type":"ContainerStarted","Data":"b9d17b528fc1c3b82fc6e5ba56db1f9cb7a6e07c8b2cf57f488d71ef9241ad97"} Jun 09 21:45:32.585139 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.585118 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hdcz" event={"ID":"e0390187-24cc-4edb-88ee-be4e2acebaba","Type":"ContainerStarted","Data":"68ac5e1662c93d0b728d453d551a8f7db2696e035b471bf1ba7ce1d57cefb641"} Jun 09 21:45:32.586207 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.586184 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerStarted","Data":"488d5e3bb3c8ad0915d03b19dfc8b9a984a6962de98c3c113350df4707f1f9b5"} Jun 09 21:45:32.587314 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.587296 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mlsc" event={"ID":"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70","Type":"ContainerStarted","Data":"5a0037160cc3b9001799b3639d10c395130439772ed4e334d3cfb94d823f5960"} Jun 09 21:45:32.588472 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.588452 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-64jmm" event={"ID":"12f9b2cc-1ce0-44fb-94ee-53043fe84a28","Type":"ContainerStarted","Data":"dc09ffb6bb935262b9e9846466b5a63dc15c9bf589d5420209607ebe4f6f90d6"} Jun 09 21:45:32.589674 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.589641 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-btmvp" event={"ID":"3ba240dd-5ec9-400d-8f30-4dc173075a7d","Type":"ContainerStarted","Data":"29cd0b9c1d501bfa0d315246f1d597424ecd79d99f340039d63f88e5ac7ea982"} Jun 09 21:45:32.590657 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.590635 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tlzm9" event={"ID":"acc53ab8-c796-4930-9e99-951bf3b0122c","Type":"ContainerStarted","Data":"39cbc687fd96c1e90fbd9da0daff3bb9513f03b3873f787b3d8b0128f7904cf5"} Jun 09 21:45:32.591597 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.591581 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" event={"ID":"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3","Type":"ContainerStarted","Data":"73bc534c07d04f802d8bccf3f0f4286ab3fb2dd8abede2661ec8af42c0a61974"} Jun 09 21:45:32.596576 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:32.596532 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-68.ec2.internal" podStartSLOduration=2.59651632 podStartE2EDuration="2.59651632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:32.596309032 +0000 UTC m=+3.460568532" watchObservedRunningTime="2026-06-09 21:45:32.59651632 +0000 UTC m=+3.460775822" Jun 09 21:45:33.127621 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.127585 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:33.127809 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.127750 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:33.127876 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.127814 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:35.127796569 +0000 UTC m=+5.992056063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:33.228025 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.227980 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:33.228211 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.228131 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:33.228211 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.228200 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret podName:c55a97ee-309d-40d3-a822-ef9bbcf3f94e nodeName:}" failed. No retries permitted until 2026-06-09 21:45:35.228179197 +0000 UTC m=+6.092438683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret") pod "global-pull-secret-syncer-5dcbz" (UID: "c55a97ee-309d-40d3-a822-ef9bbcf3f94e") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:33.329511 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.329469 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:33.337918 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.337889 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:33.337918 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.337922 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:33.338126 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.337936 2560 projected.go:196] Error preparing data for projected volume kube-api-access-k95vk for pod openshift-network-diagnostics/network-check-target-cxd5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:33.338126 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.338005 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk podName:c26132ce-b22c-46e5-bf68-f531aac4c5c0 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:35.33798572 +0000 UTC m=+6.202245213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k95vk" (UniqueName: "kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk") pod "network-check-target-cxd5q" (UID: "c26132ce-b22c-46e5-bf68-f531aac4c5c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:33.541935 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.541790 2560 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 21:40:31 +0000 UTC" deadline="2028-03-11 04:12:39.220699298 +0000 UTC" Jun 09 21:45:33.541935 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.541852 2560 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15366h27m5.67885198s" Jun 09 21:45:33.571961 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.571208 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:33.571961 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.571356 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:33.571961 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.571684 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:33.571961 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:33.571763 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:33.621300 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.621240 2560 generic.go:356] "Generic (PLEG): container finished" podID="109ea32a4fdb0c8b20767f315039b272" containerID="5f88e4ee4a59ad438de001c56e7b6c70b85cd0a2b731f3c5d9e338839f8802ef" exitCode=0 Jun 09 21:45:33.622235 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:33.622206 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" event={"ID":"109ea32a4fdb0c8b20767f315039b272","Type":"ContainerDied","Data":"5f88e4ee4a59ad438de001c56e7b6c70b85cd0a2b731f3c5d9e338839f8802ef"} Jun 09 21:45:34.568818 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:34.568790 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:34.569287 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:34.568919 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:34.640228 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:34.640191 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" event={"ID":"109ea32a4fdb0c8b20767f315039b272","Type":"ContainerStarted","Data":"227778514aff6b8da346cd5ad0ea19ed02cc0690f3bdbb5a1f160f7035a6477c"} Jun 09 21:45:34.685759 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:34.685640 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-68.ec2.internal" podStartSLOduration=4.685617469 podStartE2EDuration="4.685617469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:34.682861889 +0000 UTC m=+5.547121391" watchObservedRunningTime="2026-06-09 21:45:34.685617469 +0000 UTC m=+5.549876972" Jun 09 21:45:35.147307 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:35.147266 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:35.147499 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.147464 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:35.147580 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.147562 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:39.147541017 +0000 UTC m=+10.011800510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:35.248972 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:35.248933 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:35.249160 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.249144 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:35.249223 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.249208 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret podName:c55a97ee-309d-40d3-a822-ef9bbcf3f94e nodeName:}" failed. No retries permitted until 2026-06-09 21:45:39.249189267 +0000 UTC m=+10.113448746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret") pod "global-pull-secret-syncer-5dcbz" (UID: "c55a97ee-309d-40d3-a822-ef9bbcf3f94e") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:35.350559 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:35.349901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:35.350559 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.350094 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:35.350559 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.350117 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:35.350559 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.350130 2560 projected.go:196] Error preparing data for projected volume kube-api-access-k95vk for pod openshift-network-diagnostics/network-check-target-cxd5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:35.350559 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.350191 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk podName:c26132ce-b22c-46e5-bf68-f531aac4c5c0 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:39.350172819 +0000 UTC m=+10.214432318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k95vk" (UniqueName: "kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk") pod "network-check-target-cxd5q" (UID: "c26132ce-b22c-46e5-bf68-f531aac4c5c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:35.570888 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:35.570806 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:35.571316 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.570938 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:35.571316 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:35.571277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:35.571457 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:35.571382 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:36.568939 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:36.568460 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:36.568939 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:36.568600 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:37.569483 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:37.569449 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:37.569909 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:37.569595 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:37.569909 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:37.569654 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:37.569909 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:37.569792 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:38.569158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:38.569117 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:38.569356 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:38.569244 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:39.181362 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:39.181283 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:39.181796 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.181420 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:39.181796 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.181497 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:47.181476186 +0000 UTC m=+18.045735667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:39.282629 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:39.282594 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:39.282788 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.282761 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:39.282861 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.282837 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret podName:c55a97ee-309d-40d3-a822-ef9bbcf3f94e nodeName:}" failed. No retries permitted until 2026-06-09 21:45:47.282815691 +0000 UTC m=+18.147075190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret") pod "global-pull-secret-syncer-5dcbz" (UID: "c55a97ee-309d-40d3-a822-ef9bbcf3f94e") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:39.383517 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:39.383476 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:39.383679 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.383664 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:39.383735 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.383684 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:39.383735 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.383698 2560 projected.go:196] Error preparing data for projected volume kube-api-access-k95vk for pod openshift-network-diagnostics/network-check-target-cxd5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:39.383839 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.383753 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk podName:c26132ce-b22c-46e5-bf68-f531aac4c5c0 nodeName:}" failed. No retries permitted until 2026-06-09 21:45:47.383733881 +0000 UTC m=+18.247993374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k95vk" (UniqueName: "kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk") pod "network-check-target-cxd5q" (UID: "c26132ce-b22c-46e5-bf68-f531aac4c5c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:39.571382 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:39.571292 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:39.571513 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.571431 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:39.571876 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:39.571858 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:39.571965 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:39.571947 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:40.569374 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:40.568847 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:40.569374 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:40.568991 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:41.568519 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:41.568485 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:41.568670 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:41.568491 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:41.568670 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:41.568647 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:41.568765 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:41.568702 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:42.569320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:42.569268 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:42.569722 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:42.569452 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:43.569259 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:43.569223 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:43.569554 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:43.569383 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:43.569554 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:43.569443 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:43.569554 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:43.569533 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:44.569923 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:44.569256 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:44.569923 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:44.569621 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:45.569296 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:45.569258 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:45.569481 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:45.569258 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:45.569481 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:45.569434 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:45.569612 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:45.569540 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:46.569311 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:46.569276 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:46.569776 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:46.569446 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:47.239020 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:47.238982 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:47.239202 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.239124 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:47.239202 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.239193 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:46:03.239173291 +0000 UTC m=+34.103432784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:45:47.340091 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:47.340046 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:47.340244 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.340226 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:47.340324 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.340301 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret podName:c55a97ee-309d-40d3-a822-ef9bbcf3f94e nodeName:}" failed. No retries permitted until 2026-06-09 21:46:03.340278894 +0000 UTC m=+34.204538394 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret") pod "global-pull-secret-syncer-5dcbz" (UID: "c55a97ee-309d-40d3-a822-ef9bbcf3f94e") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:45:47.441465 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:47.441423 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:47.441623 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.441576 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:45:47.441623 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.441598 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:45:47.441623 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.441613 2560 projected.go:196] Error preparing data for projected volume kube-api-access-k95vk for pod openshift-network-diagnostics/network-check-target-cxd5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:47.441764 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.441678 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk podName:c26132ce-b22c-46e5-bf68-f531aac4c5c0 nodeName:}" failed. No retries permitted until 2026-06-09 21:46:03.44165973 +0000 UTC m=+34.305919214 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k95vk" (UniqueName: "kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk") pod "network-check-target-cxd5q" (UID: "c26132ce-b22c-46e5-bf68-f531aac4c5c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:45:47.569391 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:47.569300 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:47.569828 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.569459 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:47.569828 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:47.569494 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:47.569828 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:47.569573 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:48.569018 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:48.568971 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:48.569192 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:48.569104 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:49.569762 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:49.569731 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:49.570204 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:49.569842 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:49.570204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:49.569851 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:49.570204 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:49.569958 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:50.568430 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:50.568398 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:50.568599 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:50.568540 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:51.568373 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:51.568329 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:51.568720 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:51.568325 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:51.568720 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:51.568460 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:51.568720 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:51.568521 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:52.569087 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.568839 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:52.569894 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:52.569143 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:52.677452 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.677413 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" event={"ID":"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3","Type":"ContainerStarted","Data":"720771b16b08a767f71bd9ae9b6be4b767813ab97786b5c160232d60da07ced1"} Jun 09 21:45:52.679833 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.679812 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:45:52.680125 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.680105 2560 generic.go:356] "Generic (PLEG): container finished" podID="f9ed08f8-145e-4095-b61a-cb7cdef73032" containerID="8415a86b3944852dc197e7d70c207bb2d0938cb3383a92747c33af9baade3d30" exitCode=1 Jun 09 21:45:52.680197 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.680178 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"ec5ef0d05acf1dd57eb05a452165cc0f23826b08d511a426f3bf4accd8c6ec70"} Jun 09 21:45:52.680255 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.680238 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"c10595347a55b03420ba56a31e868a243ebed0339afb20ef7f2ec98a8f3f31cb"} Jun 09 21:45:52.680309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.680280 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"be8f199467d84eb82f08cdd33dd311b7563ff73a2a8bb35b071478dce1a6725a"} Jun 09 21:45:52.680391 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.680310 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"9b53e173f712e7c4045080ed2b4642b8191157b1a317e0675e043f4bc5da3c6d"} Jun 09 21:45:52.680391 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.680360 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerDied","Data":"8415a86b3944852dc197e7d70c207bb2d0938cb3383a92747c33af9baade3d30"} Jun 09 21:45:52.680460 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.680392 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"50692c695cada1b9003336ce9471e49af027e5fe4e60840eacb32579f4287bad"} Jun 09 21:45:52.682367 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.681971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-njdfb" event={"ID":"31639916-2d52-47e4-90b9-a15c87a3c7f8","Type":"ContainerStarted","Data":"7ee769bb9d4c4471dc27b8b24c4ef6a7bab2fd326fd138423c93b9e27d0b893e"} Jun 09 21:45:52.684477 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.684454 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7hdcz" event={"ID":"e0390187-24cc-4edb-88ee-be4e2acebaba","Type":"ContainerStarted","Data":"cb0e82fa76408e911a11760f6c41bc77481dd94ba0fc68039ff18af26b8da47c"} Jun 09 21:45:52.685931 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.685912 2560 generic.go:356] "Generic (PLEG): container finished" podID="32968818-8e4b-488a-921f-2216beb2c693" containerID="907aaa46af6e7ba4fc3216be697c3984a5db56aaa12efe89c197c8e46acae75a" exitCode=0 Jun 09 21:45:52.686016 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.685971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerDied","Data":"907aaa46af6e7ba4fc3216be697c3984a5db56aaa12efe89c197c8e46acae75a"} Jun 09 21:45:52.687450 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.687431 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9mlsc" event={"ID":"4517fb82-81a2-4b3c-b6a6-7b3ab22aac70","Type":"ContainerStarted","Data":"0782046489eb9b9903490c4935ae5f2b907cbfb5bdacbb25e84b9d144f732d38"} Jun 09 21:45:52.688812 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.688789 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-64jmm" event={"ID":"12f9b2cc-1ce0-44fb-94ee-53043fe84a28","Type":"ContainerStarted","Data":"ca28406e8385a8f4de85816e8fa4d2a1e565d93c8c1496be8241a013ee397ae2"} Jun 09 21:45:52.690054 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.690034 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-btmvp" event={"ID":"3ba240dd-5ec9-400d-8f30-4dc173075a7d","Type":"ContainerStarted","Data":"11198f7d431ac89d24079c8685767d85023dba1aabb0a1d790db1087865849da"} Jun 09 21:45:52.697903 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.697869 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-njdfb" podStartSLOduration=4.555241581 podStartE2EDuration="23.697858233s" totalImagesPullingTime="19.142616652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:52.697404477 +0000 UTC m=+23.561663978" watchObservedRunningTime="2026-06-09 21:45:52.697858233 +0000 UTC m=+23.562117727" Jun 09 21:45:52.724983 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.724936 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-64jmm" podStartSLOduration=4.572608584 podStartE2EDuration="23.724923608s" totalImagesPullingTime="19.152315024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:52.709559697 +0000 UTC m=+23.573819198" watchObservedRunningTime="2026-06-09 21:45:52.724923608 +0000 UTC m=+23.589183108" Jun 09 21:45:52.725412 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.725375 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-btmvp" podStartSLOduration=4.548701062 podStartE2EDuration="23.725368736s" totalImagesPullingTime="19.176667674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:52.725038465 +0000 UTC m=+23.589297965" watchObservedRunningTime="2026-06-09 21:45:52.725368736 +0000 UTC m=+23.589628234" Jun 09 21:45:52.768661 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.768624 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9mlsc" podStartSLOduration=4.729919577 podStartE2EDuration="23.768612834s" totalImagesPullingTime="19.038693257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:52.75480782 +0000 UTC m=+23.619067322" watchObservedRunningTime="2026-06-09 21:45:52.768612834 +0000 UTC m=+23.632872335" Jun 09 21:45:52.769281 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.769244 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7hdcz" podStartSLOduration=4.642827733 podStartE2EDuration="23.769234314s" totalImagesPullingTime="19.126406581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:52.768477023 +0000 UTC m=+23.632736524" watchObservedRunningTime="2026-06-09 21:45:52.769234314 +0000 UTC m=+23.633493816" Jun 09 21:45:52.872842 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.872805 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:52.949573 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:52.949519 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:53.160734 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.160706 2560 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 21:45:53.568607 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.568520 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:53.568850 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:53.568657 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:53.568850 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.568716 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:53.568850 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:53.568836 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:53.580244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.580156 2560 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T21:45:53.160727222Z","UUID":"64128ae8-4a9a-4611-8666-2b12e1064ece","Handler":null,"Name":"","Endpoint":""} Jun 09 21:45:53.581991 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.581967 2560 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 21:45:53.582110 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.582012 2560 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 21:45:53.694510 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.694467 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tlzm9" event={"ID":"acc53ab8-c796-4930-9e99-951bf3b0122c","Type":"ContainerStarted","Data":"7f3ff94b30b909b41edd35e02bc16d77e12673d97a4614961fae0096a3405d35"} Jun 09 21:45:53.698640 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.698562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" event={"ID":"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3","Type":"ContainerStarted","Data":"de481f4ec2941cba8c24d2758a898cd3813f4a8eb5ae55dfa8c02658502e8c6d"} Jun 09 21:45:53.708844 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.708782 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tlzm9" podStartSLOduration=5.559200964 podStartE2EDuration="24.708761273s" totalImagesPullingTime="19.149560309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:53.707747681 +0000 UTC m=+24.572007183" watchObservedRunningTime="2026-06-09 21:45:53.708761273 +0000 UTC m=+24.573020775" Jun 09 21:45:53.825490 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.825398 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:53.876243 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.876209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:53.907169 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:53.907135 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:54.568623 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:54.568599 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:54.568769 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:54.568742 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:54.704059 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:54.704025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" event={"ID":"a79bcbd4-fde3-4606-a6b9-61d44da6b1b3","Type":"ContainerStarted","Data":"ba8b24f50746dd1175d0b6036d465f9578e1fabe82d60f26063ebf6944f87a6c"} Jun 09 21:45:54.707391 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:54.707369 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:45:54.707813 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:54.707793 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"517b18c36a8cb066fb055191b86500731e22daaa75b703aa9f4e00fa92f716b0"} Jun 09 21:45:54.720361 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:54.720269 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgssn" podStartSLOduration=4.559169946 podStartE2EDuration="25.720251912s" totalImagesPullingTime="21.161081966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:54.719534744 +0000 UTC m=+25.583794246" watchObservedRunningTime="2026-06-09 21:45:54.720251912 +0000 UTC m=+25.584511414" Jun 09 21:45:55.568719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:55.568688 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:55.568898 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:55.568826 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:55.569167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:55.569149 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:55.569252 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:55.569237 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:56.347977 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.347928 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:56.397618 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.397582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:56.568570 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.568539 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:56.568727 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:56.568669 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:56.718647 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.718174 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:45:56.718963 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.718693 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"3a638e76ded80155cc8a26935677099bdd8a6734d19704d221416b6c623bdef1"} Jun 09 21:45:56.718963 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.718938 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:56.719246 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.719011 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:56.719246 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.719054 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:56.719246 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.719189 2560 scope.go:117] "RemoveContainer" containerID="8415a86b3944852dc197e7d70c207bb2d0938cb3383a92747c33af9baade3d30" Jun 09 21:45:56.737948 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.737928 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:56.738875 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.738860 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:45:56.791928 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.791898 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:56.792879 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:56.792856 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:57.569255 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.569221 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:57.569255 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.569251 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:57.569782 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:57.569349 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:57.569782 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:57.569447 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:57.723304 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.723275 2560 generic.go:356] "Generic (PLEG): container finished" podID="32968818-8e4b-488a-921f-2216beb2c693" containerID="01405a10becf9498cd0754401b4a0ed60135cd16ddfcb61950f193de0e0eb90a" exitCode=0 Jun 09 21:45:57.723473 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.723366 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerDied","Data":"01405a10becf9498cd0754401b4a0ed60135cd16ddfcb61950f193de0e0eb90a"} Jun 09 21:45:57.727355 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.727318 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:45:57.727753 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.727721 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" event={"ID":"f9ed08f8-145e-4095-b61a-cb7cdef73032","Type":"ContainerStarted","Data":"45f1df70ca07f345525d5f2dc307a76d1892884ba2b2bdc483e5ce8350b341c5"} Jun 09 21:45:57.728328 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.728311 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9mlsc" Jun 09 21:45:57.763634 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.763592 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" podStartSLOduration=9.558217184 podStartE2EDuration="28.763576699s" totalImagesPullingTime="19.205359515s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:45:57.762571238 +0000 UTC m=+28.626830739" watchObservedRunningTime="2026-06-09 21:45:57.763576699 +0000 UTC m=+28.627836201" Jun 09 21:45:57.818877 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:57.818850 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:58.183389 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.183260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:58.231650 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.231617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:45:58.568645 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.568459 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:58.568781 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:58.568738 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:58.614277 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.614244 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5dcbz"] Jun 09 21:45:58.614665 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.614373 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:45:58.614665 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:58.614457 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:45:58.617413 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.617292 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cxd5q"] Jun 09 21:45:58.617534 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.617457 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:45:58.617588 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:58.617569 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:45:58.617997 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.617975 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5fx7"] Jun 09 21:45:58.731063 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:58.731005 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:45:58.731180 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:45:58.731145 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:45:59.735211 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:59.735179 2560 generic.go:356] "Generic (PLEG): container finished" podID="32968818-8e4b-488a-921f-2216beb2c693" containerID="d4c1dd6c7dccfd826d7e93c2d6832e3b4fe00e240229723c06b3e0a87b71eccd" exitCode=0 Jun 09 21:45:59.735840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:45:59.735240 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerDied","Data":"d4c1dd6c7dccfd826d7e93c2d6832e3b4fe00e240229723c06b3e0a87b71eccd"} Jun 09 21:46:00.568512 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:00.568479 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:46:00.568512 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:00.568511 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:00.568707 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:00.568588 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:46:00.568707 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:00.568624 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:46:00.568707 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:00.568696 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:46:00.568814 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:00.568764 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:46:01.742498 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:01.742456 2560 generic.go:356] "Generic (PLEG): container finished" podID="32968818-8e4b-488a-921f-2216beb2c693" containerID="4049d980e17c34c37ef90740ed83d471f062a4057249ba087ace7032a80d2115" exitCode=0 Jun 09 21:46:01.743161 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:01.742517 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerDied","Data":"4049d980e17c34c37ef90740ed83d471f062a4057249ba087ace7032a80d2115"} Jun 09 21:46:02.568893 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:02.568856 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:46:02.569182 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:02.568900 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:02.569182 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:02.568856 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:46:02.569182 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:02.569005 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:46:02.569182 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:02.569098 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxd5q" podUID="c26132ce-b22c-46e5-bf68-f531aac4c5c0" Jun 09 21:46:02.569379 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:02.569191 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5dcbz" podUID="c55a97ee-309d-40d3-a822-ef9bbcf3f94e" Jun 09 21:46:03.256112 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:03.256025 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:46:03.256577 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.256211 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:46:03.256577 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.256297 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:46:35.256275419 +0000 UTC m=+66.120534917 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 21:46:03.357082 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:03.357038 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:46:03.357266 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.357203 2560 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 21:46:03.357328 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.357284 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret podName:c55a97ee-309d-40d3-a822-ef9bbcf3f94e nodeName:}" failed. No retries permitted until 2026-06-09 21:46:35.357263617 +0000 UTC m=+66.221523110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret") pod "global-pull-secret-syncer-5dcbz" (UID: "c55a97ee-309d-40d3-a822-ef9bbcf3f94e") : object "kube-system"/"original-pull-secret" not registered Jun 09 21:46:03.457690 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:03.457652 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:03.457861 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.457813 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 21:46:03.457861 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.457838 2560 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 21:46:03.457861 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.457851 2560 projected.go:196] Error preparing data for projected volume kube-api-access-k95vk for pod openshift-network-diagnostics/network-check-target-cxd5q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:46:03.458014 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:03.457924 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk podName:c26132ce-b22c-46e5-bf68-f531aac4c5c0 nodeName:}" failed. No retries permitted until 2026-06-09 21:46:35.457902185 +0000 UTC m=+66.322161678 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k95vk" (UniqueName: "kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk") pod "network-check-target-cxd5q" (UID: "c26132ce-b22c-46e5-bf68-f531aac4c5c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 21:46:04.480125 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.479922 2560 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-68.ec2.internal" event="NodeReady" Jun 09 21:46:04.480534 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.480238 2560 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 21:46:04.522409 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.522370 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pqkwv"] Jun 09 21:46:04.528025 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.528001 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lzqkt"] Jun 09 21:46:04.528176 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.528128 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.530437 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.530413 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qwpdx\"" Jun 09 21:46:04.530437 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.530430 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 21:46:04.530591 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.530529 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 21:46:04.531754 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.531734 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:04.535320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.534308 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 21:46:04.535320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.534700 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 21:46:04.535320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.534930 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dnqvv\"" Jun 09 21:46:04.535320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.535109 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzqkt"] Jun 09 21:46:04.535320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.535148 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqkwv"] Jun 09 21:46:04.535320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.535112 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 21:46:04.568435 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.568402 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:46:04.568592 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.568529 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:46:04.568592 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.568578 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:04.571132 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.571112 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2kzr\"" Jun 09 21:46:04.571538 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.571515 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 21:46:04.571687 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.571660 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 21:46:04.571800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.571784 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x5mcl\"" Jun 09 21:46:04.572020 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.572007 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 21:46:04.579114 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.579096 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 21:46:04.665436 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.665402 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:04.667219 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.667187 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.667355 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.667239 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ed86f98-98e1-4d01-81c3-55d4594957e6-cert\") pod \"ingress-canary-lzqkt\" (UID: \"1ed86f98-98e1-4d01-81c3-55d4594957e6\") " pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:04.667355 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.667314 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6pd8\" (UniqueName: \"kubernetes.io/projected/1ed86f98-98e1-4d01-81c3-55d4594957e6-kube-api-access-k6pd8\") pod \"ingress-canary-lzqkt\" (UID: \"1ed86f98-98e1-4d01-81c3-55d4594957e6\") " pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:04.667441 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.667406 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d58b3cb4-2a60-4e55-8507-6b990274c90a-config-volume\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.667485 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.667438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58b3cb4-2a60-4e55-8507-6b990274c90a-tmp-dir\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.667529 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.667461 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsj6n\" (UniqueName: \"kubernetes.io/projected/d58b3cb4-2a60-4e55-8507-6b990274c90a-kube-api-access-dsj6n\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.723328 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.723287 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:04.768785 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.768752 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d58b3cb4-2a60-4e55-8507-6b990274c90a-config-volume\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.768969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.768809 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58b3cb4-2a60-4e55-8507-6b990274c90a-tmp-dir\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.768969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.768837 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsj6n\" (UniqueName: \"kubernetes.io/projected/d58b3cb4-2a60-4e55-8507-6b990274c90a-kube-api-access-dsj6n\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.768969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.768895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.768969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.768926 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ed86f98-98e1-4d01-81c3-55d4594957e6-cert\") pod \"ingress-canary-lzqkt\" (UID: \"1ed86f98-98e1-4d01-81c3-55d4594957e6\") " pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:04.768969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.768948 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pd8\" (UniqueName: \"kubernetes.io/projected/1ed86f98-98e1-4d01-81c3-55d4594957e6-kube-api-access-k6pd8\") pod \"ingress-canary-lzqkt\" (UID: \"1ed86f98-98e1-4d01-81c3-55d4594957e6\") " pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:04.769240 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.769212 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d58b3cb4-2a60-4e55-8507-6b990274c90a-tmp-dir\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.769381 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:04.769358 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:04.769442 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.769379 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d58b3cb4-2a60-4e55-8507-6b990274c90a-config-volume\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.769442 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:04.769425 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:46:05.269410329 +0000 UTC m=+36.133669831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:46:04.773760 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.773738 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1ed86f98-98e1-4d01-81c3-55d4594957e6-cert\") pod \"ingress-canary-lzqkt\" (UID: \"1ed86f98-98e1-4d01-81c3-55d4594957e6\") " pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:04.779111 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.779087 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsj6n\" (UniqueName: \"kubernetes.io/projected/d58b3cb4-2a60-4e55-8507-6b990274c90a-kube-api-access-dsj6n\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:04.779309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.779289 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pd8\" (UniqueName: \"kubernetes.io/projected/1ed86f98-98e1-4d01-81c3-55d4594957e6-kube-api-access-k6pd8\") pod \"ingress-canary-lzqkt\" (UID: \"1ed86f98-98e1-4d01-81c3-55d4594957e6\") " pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:04.847428 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:04.847351 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lzqkt" Jun 09 21:46:05.272797 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:05.272699 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:05.272966 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:05.272851 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:05.272966 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:05.272918 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:46:06.272902942 +0000 UTC m=+37.137162422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:46:05.750125 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:05.750076 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lzqkt"] Jun 09 21:46:05.754631 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:46:05.754607 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed86f98_98e1_4d01_81c3_55d4594957e6.slice/crio-45cacfc460adfb0db3d5a5303ebd90e3935a03f557a4c2430e14214e02ded682 WatchSource:0}: Error finding container 45cacfc460adfb0db3d5a5303ebd90e3935a03f557a4c2430e14214e02ded682: Status 404 returned error can't find the container with id 45cacfc460adfb0db3d5a5303ebd90e3935a03f557a4c2430e14214e02ded682 Jun 09 21:46:06.281150 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:06.281112 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:06.281314 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:06.281268 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:06.281376 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:06.281354 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:46:08.28131949 +0000 UTC m=+39.145578998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:46:06.759457 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:06.759423 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzqkt" event={"ID":"1ed86f98-98e1-4d01-81c3-55d4594957e6","Type":"ContainerStarted","Data":"45cacfc460adfb0db3d5a5303ebd90e3935a03f557a4c2430e14214e02ded682"} Jun 09 21:46:06.762076 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:06.762053 2560 generic.go:356] "Generic (PLEG): container finished" podID="32968818-8e4b-488a-921f-2216beb2c693" containerID="02d68cc8187b176c321e37c5d50009a7f8ac3e4cbefbf741896b70edb14708b9" exitCode=0 Jun 09 21:46:06.762197 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:06.762087 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerDied","Data":"02d68cc8187b176c321e37c5d50009a7f8ac3e4cbefbf741896b70edb14708b9"} Jun 09 21:46:07.767063 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:07.767021 2560 generic.go:356] "Generic (PLEG): container finished" podID="32968818-8e4b-488a-921f-2216beb2c693" containerID="4153e5d44d79e43db460411fc8980b6049a1fce98b40d41c8b8960460db27bd0" exitCode=0 Jun 09 21:46:07.767457 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:07.767081 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerDied","Data":"4153e5d44d79e43db460411fc8980b6049a1fce98b40d41c8b8960460db27bd0"} Jun 09 21:46:08.296066 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:08.296033 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:08.296207 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:08.296178 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:08.296252 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:08.296242 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:46:12.296224555 +0000 UTC m=+43.160484048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:46:08.770929 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:08.770893 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lzqkt" event={"ID":"1ed86f98-98e1-4d01-81c3-55d4594957e6","Type":"ContainerStarted","Data":"7e394bcf6d614f2e5a66d1e55fc9caaa586196e43e272fa34ee0c38aa3c1e140"} Jun 09 21:46:08.774099 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:08.774074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzst2" event={"ID":"32968818-8e4b-488a-921f-2216beb2c693","Type":"ContainerStarted","Data":"a23d9bc025ddd932602dc8585413c45557ecd17ff25e16e916071477e58c8251"} Jun 09 21:46:08.804754 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:08.804703 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lzqkt" podStartSLOduration=2.736463743 podStartE2EDuration="4.804683023s" totalImagesPullingTime="2.06821928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:46:08.784928493 +0000 UTC m=+39.649187995" watchObservedRunningTime="2026-06-09 21:46:08.804683023 +0000 UTC m=+39.668942525" Jun 09 21:46:08.805174 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:08.805139 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wzst2" podStartSLOduration=10.69359938 podStartE2EDuration="39.805128803s" totalImagesPullingTime="29.111529423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:46:08.803588114 +0000 UTC m=+39.667847614" watchObservedRunningTime="2026-06-09 21:46:08.805128803 +0000 UTC m=+39.669388304" Jun 09 21:46:08.925682 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:08.925642 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:08.978264 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:08.978225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:09.745484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:09.745439 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:09.789438 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:09.789404 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:12.322949 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:12.322913 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:12.323326 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:12.323022 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:12.323326 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:12.323075 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:46:20.323061187 +0000 UTC m=+51.187320678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:46:12.815465 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:12.815432 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:12.863736 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:12.863707 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:14.325084 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:14.325049 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:14.373973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:14.373934 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:19.377956 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.377920 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r"] Jun 09 21:46:19.415618 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.415578 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r"] Jun 09 21:46:19.415787 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.415704 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.418310 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.418280 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 21:46:19.418477 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.418279 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 21:46:19.418477 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.418331 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 21:46:19.418477 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.418280 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 21:46:19.418477 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.418430 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 21:46:19.418477 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.418280 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 21:46:19.419182 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.419160 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 21:46:19.573642 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.573611 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.573642 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.573652 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-hub\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.573888 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.573731 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.573888 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.573819 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-ca\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.573888 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.573854 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.573888 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.573875 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrd94\" (UniqueName: \"kubernetes.io/projected/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-kube-api-access-hrd94\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.675124 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.675029 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-ca\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.675124 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.675072 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.675124 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.675095 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrd94\" (UniqueName: \"kubernetes.io/projected/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-kube-api-access-hrd94\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.675430 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.675126 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.675430 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.675154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-hub\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.675430 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.675199 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.675862 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.675837 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.678798 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.678767 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-ca\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.678798 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.678786 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.678930 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.678775 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-hub\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.678930 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.678908 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.682998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.682976 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrd94\" (UniqueName: \"kubernetes.io/projected/65e3c4a6-8966-44e8-9afd-6a38ebbb601d-kube-api-access-hrd94\") pod \"cluster-proxy-proxy-agent-6c5b7bc569-5zj5r\" (UID: \"65e3c4a6-8966-44e8-9afd-6a38ebbb601d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.732692 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.732658 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:46:19.884030 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:19.884000 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r"] Jun 09 21:46:19.887617 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:46:19.887586 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65e3c4a6_8966_44e8_9afd_6a38ebbb601d.slice/crio-6fd1f306099d0430c5aae57d5e3ea1bdd42f3416fd9028336c4ffc4227854ec3 WatchSource:0}: Error finding container 6fd1f306099d0430c5aae57d5e3ea1bdd42f3416fd9028336c4ffc4227854ec3: Status 404 returned error can't find the container with id 6fd1f306099d0430c5aae57d5e3ea1bdd42f3416fd9028336c4ffc4227854ec3 Jun 09 21:46:20.381283 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:20.381249 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:20.381696 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:20.381382 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:20.381696 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:20.381436 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:46:36.381421754 +0000 UTC m=+67.245681232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:46:20.802876 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:20.802791 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" event={"ID":"65e3c4a6-8966-44e8-9afd-6a38ebbb601d","Type":"ContainerStarted","Data":"6fd1f306099d0430c5aae57d5e3ea1bdd42f3416fd9028336c4ffc4227854ec3"} Jun 09 21:46:28.743190 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:28.743163 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gfwh8" Jun 09 21:46:28.851483 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:28.851436 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:28.902985 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:28.902945 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:46:29.827061 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:29.827023 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" event={"ID":"65e3c4a6-8966-44e8-9afd-6a38ebbb601d","Type":"ContainerStarted","Data":"68487a6c6ae691d21cef000fc5e979341fe5bf8ab718d017d3eed9e8711e266c"} Jun 09 21:46:29.827553 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:29.827071 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" event={"ID":"65e3c4a6-8966-44e8-9afd-6a38ebbb601d","Type":"ContainerStarted","Data":"9541beed573a2b0e5959aedd31c2d3979868a9f67c7125ef17426c6d66537c5b"} Jun 09 21:46:29.827553 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:29.827083 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" event={"ID":"65e3c4a6-8966-44e8-9afd-6a38ebbb601d","Type":"ContainerStarted","Data":"f5b4a62a27aa4ef6a38a59b7ba35a06b4e24e0ef612142fa0b380e70d77775e3"} Jun 09 21:46:29.844124 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:29.844077 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" podStartSLOduration=1.08513012 podStartE2EDuration="10.844062894s" totalImagesPullingTime="9.758932774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:46:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:46:29.842418729 +0000 UTC m=+60.706678231" watchObservedRunningTime="2026-06-09 21:46:29.844062894 +0000 UTC m=+60.708322394" Jun 09 21:46:35.287130 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.287091 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:46:35.293519 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.293498 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 21:46:35.297410 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:35.297397 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 21:46:35.297472 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:35.297462 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:47:39.297447044 +0000 UTC m=+130.161706536 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : secret "metrics-daemon-secret" not found Jun 09 21:46:35.387803 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.387773 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:46:35.390695 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.390677 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 21:46:35.400841 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.400806 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c55a97ee-309d-40d3-a822-ef9bbcf3f94e-original-pull-secret\") pod \"global-pull-secret-syncer-5dcbz\" (UID: \"c55a97ee-309d-40d3-a822-ef9bbcf3f94e\") " pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:46:35.486389 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.486326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5dcbz" Jun 09 21:46:35.488007 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.487988 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:35.490920 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.490899 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 21:46:35.500631 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.500606 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 21:46:35.511915 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.511891 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k95vk\" (UniqueName: \"kubernetes.io/projected/c26132ce-b22c-46e5-bf68-f531aac4c5c0-kube-api-access-k95vk\") pod \"network-check-target-cxd5q\" (UID: \"c26132ce-b22c-46e5-bf68-f531aac4c5c0\") " pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:35.618872 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.618840 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5dcbz"] Jun 09 21:46:35.622298 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:46:35.622270 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55a97ee_309d_40d3_a822_ef9bbcf3f94e.slice/crio-af1160e97df29fbb788ac37f4af264976e81a43a0275eb24f9fb563bab43a713 WatchSource:0}: Error finding container af1160e97df29fbb788ac37f4af264976e81a43a0275eb24f9fb563bab43a713: Status 404 returned error can't find the container with id af1160e97df29fbb788ac37f4af264976e81a43a0275eb24f9fb563bab43a713 Jun 09 21:46:35.793710 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.793680 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s2kzr\"" Jun 09 21:46:35.802441 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.802422 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:35.846479 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.846441 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5dcbz" event={"ID":"c55a97ee-309d-40d3-a822-ef9bbcf3f94e","Type":"ContainerStarted","Data":"af1160e97df29fbb788ac37f4af264976e81a43a0275eb24f9fb563bab43a713"} Jun 09 21:46:35.919021 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:35.918991 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cxd5q"] Jun 09 21:46:35.922076 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:46:35.922052 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26132ce_b22c_46e5_bf68_f531aac4c5c0.slice/crio-d524aef0d362029f743c3e289f8271cc7c66011eb09973d2ec8934fd2201f45c WatchSource:0}: Error finding container d524aef0d362029f743c3e289f8271cc7c66011eb09973d2ec8934fd2201f45c: Status 404 returned error can't find the container with id d524aef0d362029f743c3e289f8271cc7c66011eb09973d2ec8934fd2201f45c Jun 09 21:46:36.393633 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:36.393004 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:46:36.393633 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:36.393216 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:46:36.393633 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:46:36.393281 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:47:08.393263237 +0000 UTC m=+99.257522716 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:46:36.850533 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:36.850491 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cxd5q" event={"ID":"c26132ce-b22c-46e5-bf68-f531aac4c5c0","Type":"ContainerStarted","Data":"d524aef0d362029f743c3e289f8271cc7c66011eb09973d2ec8934fd2201f45c"} Jun 09 21:46:40.863413 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:40.863371 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5dcbz" event={"ID":"c55a97ee-309d-40d3-a822-ef9bbcf3f94e","Type":"ContainerStarted","Data":"b79c84febb2fcf99e6fc86be24f47f5bfbed8b2c1a8c2e1cf70cbb75f7236117"} Jun 09 21:46:40.864775 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:40.864750 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cxd5q" event={"ID":"c26132ce-b22c-46e5-bf68-f531aac4c5c0","Type":"ContainerStarted","Data":"71f4fa2cf75b820bf6fec5715b8a8b0e270b74b30dadf6d5946f4a8c9f01cb67"} Jun 09 21:46:40.864893 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:40.864880 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:46:40.877889 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:40.877840 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5dcbz" podStartSLOduration=67.370257547 podStartE2EDuration="1m11.877823064s" totalImagesPullingTime="4.507565517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:46:40.877784591 +0000 UTC m=+71.742044093" watchObservedRunningTime="2026-06-09 21:46:40.877823064 +0000 UTC m=+71.742082567" Jun 09 21:46:40.892298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:46:40.892257 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cxd5q" podStartSLOduration=67.688189143 podStartE2EDuration="1m11.89224315s" totalImagesPullingTime="4.204054007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:46:40.891433878 +0000 UTC m=+71.755693398" watchObservedRunningTime="2026-06-09 21:46:40.89224315 +0000 UTC m=+71.756502629" Jun 09 21:47:08.410236 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:47:08.410197 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:47:08.410675 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:47:08.410321 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:47:08.410675 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:47:08.410405 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:48:12.410388944 +0000 UTC m=+163.274648436 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:47:11.871000 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:47:11.870969 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cxd5q" Jun 09 21:47:39.317237 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:47:39.317195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:47:39.317745 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:47:39.317308 2560 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 21:47:39.317745 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:47:39.317396 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs podName:b9d90437-5a29-4e28-b396-61a3c8df3d57 nodeName:}" failed. No retries permitted until 2026-06-09 21:49:41.31737274 +0000 UTC m=+252.181632232 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs") pod "network-metrics-daemon-f5fx7" (UID: "b9d90437-5a29-4e28-b396-61a3c8df3d57") : secret "metrics-daemon-secret" not found Jun 09 21:48:07.541545 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:48:07.541489 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pqkwv" podUID="d58b3cb4-2a60-4e55-8507-6b990274c90a" Jun 09 21:48:07.578712 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:48:07.578681 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f5fx7" podUID="b9d90437-5a29-4e28-b396-61a3c8df3d57" Jun 09 21:48:08.110694 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:08.110664 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqkwv" Jun 09 21:48:12.445847 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:12.445737 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:48:12.446258 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:48:12.445900 2560 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 21:48:12.446258 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:48:12.445975 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls podName:d58b3cb4-2a60-4e55-8507-6b990274c90a nodeName:}" failed. No retries permitted until 2026-06-09 21:50:14.445959368 +0000 UTC m=+285.310218860 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls") pod "dns-default-pqkwv" (UID: "d58b3cb4-2a60-4e55-8507-6b990274c90a") : secret "dns-default-metrics-tls" not found Jun 09 21:48:20.569186 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:20.569138 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:48:20.672445 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:20.672419 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:51.850917 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.850879 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn"] Jun 09 21:48:51.853106 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.853090 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:51.855048 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.855023 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 21:48:51.855391 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.855373 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 21:48:51.856061 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.856044 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-6rhzb\"" Jun 09 21:48:51.856119 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.856082 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 21:48:51.856161 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.856126 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 21:48:51.865430 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.865403 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn"] Jun 09 21:48:51.922268 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.922236 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/483151ca-20ab-4d36-a8de-852eeeb2ee8b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:51.922268 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.922268 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/483151ca-20ab-4d36-a8de-852eeeb2ee8b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:51.922518 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:51.922306 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhg7p\" (UniqueName: \"kubernetes.io/projected/483151ca-20ab-4d36-a8de-852eeeb2ee8b-kube-api-access-xhg7p\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.000655 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.000617 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:52.023688 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.023658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/483151ca-20ab-4d36-a8de-852eeeb2ee8b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.023840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.023690 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/483151ca-20ab-4d36-a8de-852eeeb2ee8b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.023888 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.023832 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhg7p\" (UniqueName: \"kubernetes.io/projected/483151ca-20ab-4d36-a8de-852eeeb2ee8b-kube-api-access-xhg7p\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.024242 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.024223 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/483151ca-20ab-4d36-a8de-852eeeb2ee8b-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.026114 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.026091 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/483151ca-20ab-4d36-a8de-852eeeb2ee8b-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.031267 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.031195 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhg7p\" (UniqueName: \"kubernetes.io/projected/483151ca-20ab-4d36-a8de-852eeeb2ee8b-kube-api-access-xhg7p\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-zrjsn\" (UID: \"483151ca-20ab-4d36-a8de-852eeeb2ee8b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.162231 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.162139 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" Jun 09 21:48:52.285699 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:52.285666 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn"] Jun 09 21:48:52.289063 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:48:52.289038 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483151ca_20ab_4d36_a8de_852eeeb2ee8b.slice/crio-db1f1e81d8e35cc9e1bfa84a2d27d85ba9bf87067fd10dd6f84a1aea68c2d016 WatchSource:0}: Error finding container db1f1e81d8e35cc9e1bfa84a2d27d85ba9bf87067fd10dd6f84a1aea68c2d016: Status 404 returned error can't find the container with id db1f1e81d8e35cc9e1bfa84a2d27d85ba9bf87067fd10dd6f84a1aea68c2d016 Jun 09 21:48:53.050749 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:53.050710 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:53.236596 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:53.236563 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" event={"ID":"483151ca-20ab-4d36-a8de-852eeeb2ee8b","Type":"ContainerStarted","Data":"db1f1e81d8e35cc9e1bfa84a2d27d85ba9bf87067fd10dd6f84a1aea68c2d016"} Jun 09 21:48:54.238296 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:54.238271 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:54.339055 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:54.339019 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:55.243669 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:55.243628 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" event={"ID":"483151ca-20ab-4d36-a8de-852eeeb2ee8b","Type":"ContainerStarted","Data":"f4dbbd5e94bd0a8c055f5e94c9506ed0ed3c28b70300cd97a1b165a58c6e7228"} Jun 09 21:48:55.258729 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:55.258674 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" podStartSLOduration=2.337620763 podStartE2EDuration="4.258657099s" totalImagesPullingTime="1.921036336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:48:55.257181179 +0000 UTC m=+206.121440692" watchObservedRunningTime="2026-06-09 21:48:55.258657099 +0000 UTC m=+206.122916632" Jun 09 21:48:55.324115 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:55.324081 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:55.418420 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:55.418386 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:55.518323 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:55.518243 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:57.465544 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:57.465511 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:57.516375 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:57.516329 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:57.813040 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:57.812969 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:57.914356 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:57.914318 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:57.960842 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:57.960815 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:58.167242 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:58.167206 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:58.220587 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:58.220554 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:59.679325 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:59.679298 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-64jmm_12f9b2cc-1ce0-44fb-94ee-53043fe84a28/dns-node-resolver/0.log" Jun 09 21:48:59.794315 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:59.794282 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:48:59.840292 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:48:59.840262 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:00.611507 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:00.611477 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:00.680065 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:00.680043 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hdcz_e0390187-24cc-4edb-88ee-be4e2acebaba/node-ca/0.log" Jun 09 21:49:01.684103 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:01.684077 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lzqkt_1ed86f98-98e1-4d01-81c3-55d4594957e6/serve-healthcheck-canary/0.log" Jun 09 21:49:02.009819 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:02.009731 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:02.112227 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:02.112200 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:02.530759 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:02.530729 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:02.631213 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:02.631183 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:02.732567 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:02.732534 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:02.783190 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:02.783110 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:03.290045 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:03.290014 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:03.904232 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:03.904194 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:04.099942 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:04.099909 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:04.299838 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:04.299756 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:04.503376 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:04.503326 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:04.703318 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:04.703288 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:04.803930 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:04.803894 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:05.830113 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:05.830080 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:05.930939 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:05.930907 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:05.976384 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:05.976359 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:06.107219 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:06.107188 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:06.303147 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:06.303116 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:06.503973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:06.503885 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:06.602864 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:06.602800 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:06.703110 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:06.703082 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:07.905587 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:07.905551 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:08.098993 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:08.098959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:08.296453 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:08.296424 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:08.397005 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:08.396975 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:08.497529 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:08.497457 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:08.605603 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:08.605576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:08.706694 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:08.706652 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:09.702960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:09.702926 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:09.734241 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:09.734202 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" podUID="65e3c4a6-8966-44e8-9afd-6a38ebbb601d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 21:49:10.096323 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:10.096294 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:10.297257 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:10.297215 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:10.498782 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:10.498702 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:10.706185 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:10.706152 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:11.698427 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:11.698391 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:12.103626 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:12.103600 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:12.299304 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:12.299273 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:12.500748 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:12.500663 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:12.700392 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:12.700357 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:13.174012 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:13.173981 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:13.220459 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:13.220429 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:15.122930 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:15.122898 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:15.222925 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:15.222890 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:15.420432 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:15.420353 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:15.605093 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:15.605057 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:15.799463 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:15.799379 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:15.849587 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:15.849558 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:16.023882 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:16.023852 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:16.074869 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:16.074803 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:16.227491 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:16.227467 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:16.274678 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:16.274650 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:16.810540 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:16.810508 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:16.943582 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:16.943548 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:17.205884 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:17.205851 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:18.423327 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:18.423290 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:18.473784 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:18.473753 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:19.733889 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:19.733851 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" podUID="65e3c4a6-8966-44e8-9afd-6a38ebbb601d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 21:49:20.089638 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.089607 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rbfhc"] Jun 09 21:49:20.092349 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.092318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.094673 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.094647 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 21:49:20.094786 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.094703 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2btps\"" Jun 09 21:49:20.095740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.095722 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 21:49:20.095740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.095734 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 21:49:20.095872 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.095741 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 21:49:20.103678 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.103654 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbfhc"] Jun 09 21:49:20.156470 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.156439 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-578796694c-t4dc7"] Jun 09 21:49:20.159075 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.159054 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.161139 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.161110 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 21:49:20.161255 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.161240 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 21:49:20.161400 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.161384 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 21:49:20.161462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.161407 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-2zngw\"" Jun 09 21:49:20.166147 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.166128 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 21:49:20.170307 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.170288 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-578796694c-t4dc7"] Jun 09 21:49:20.224192 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.224162 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:20.236575 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.236548 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-559kf\" (UniqueName: \"kubernetes.io/projected/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-kube-api-access-559kf\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.236689 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.236626 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-crio-socket\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.236689 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.236658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.236813 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.236706 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-data-volume\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.236813 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.236730 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.323754 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.323726 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:20.337305 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337282 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-registry-tls\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337310 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8dcf8fcb-5d35-4997-a76c-2540d0803203-ca-trust-extracted\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337327 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8dcf8fcb-5d35-4997-a76c-2540d0803203-trusted-ca\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337391 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-crio-socket\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.337523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337426 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-892dk\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-kube-api-access-892dk\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337462 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-data-volume\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.337523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337478 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.337523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337493 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-crio-socket\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.337523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337505 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-bound-sa-token\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337521 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8dcf8fcb-5d35-4997-a76c-2540d0803203-registry-certificates\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337724 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337572 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.337724 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337593 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8dcf8fcb-5d35-4997-a76c-2540d0803203-image-registry-private-configuration\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337724 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337624 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-559kf\" (UniqueName: \"kubernetes.io/projected/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-kube-api-access-559kf\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.337724 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337650 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8dcf8fcb-5d35-4997-a76c-2540d0803203-installation-pull-secrets\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.337849 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.337822 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-data-volume\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.338053 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.338025 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.339978 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.339929 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.346623 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.346603 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-559kf\" (UniqueName: \"kubernetes.io/projected/88d78bcd-3ac6-483c-8bb5-98c67ac49ae7-kube-api-access-559kf\") pod \"insights-runtime-extractor-rbfhc\" (UID: \"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7\") " pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.400797 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.400772 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbfhc" Jun 09 21:49:20.438611 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438571 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-bound-sa-token\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.438611 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438604 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8dcf8fcb-5d35-4997-a76c-2540d0803203-registry-certificates\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.438840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438640 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8dcf8fcb-5d35-4997-a76c-2540d0803203-image-registry-private-configuration\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.438840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438663 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8dcf8fcb-5d35-4997-a76c-2540d0803203-installation-pull-secrets\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.438840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438714 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-registry-tls\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.438840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438759 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8dcf8fcb-5d35-4997-a76c-2540d0803203-ca-trust-extracted\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.438840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438785 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8dcf8fcb-5d35-4997-a76c-2540d0803203-trusted-ca\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.438840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.438813 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-892dk\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-kube-api-access-892dk\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.439130 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.439107 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8dcf8fcb-5d35-4997-a76c-2540d0803203-ca-trust-extracted\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.439549 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.439522 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8dcf8fcb-5d35-4997-a76c-2540d0803203-registry-certificates\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.439815 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.439789 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8dcf8fcb-5d35-4997-a76c-2540d0803203-trusted-ca\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.441933 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.441901 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8dcf8fcb-5d35-4997-a76c-2540d0803203-image-registry-private-configuration\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.442049 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.441931 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-registry-tls\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.442204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.442186 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8dcf8fcb-5d35-4997-a76c-2540d0803203-installation-pull-secrets\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.445972 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.445952 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-bound-sa-token\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.446148 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.446128 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-892dk\" (UniqueName: \"kubernetes.io/projected/8dcf8fcb-5d35-4997-a76c-2540d0803203-kube-api-access-892dk\") pod \"image-registry-578796694c-t4dc7\" (UID: \"8dcf8fcb-5d35-4997-a76c-2540d0803203\") " pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.467906 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.467870 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:20.531146 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.531122 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbfhc"] Jun 09 21:49:20.534686 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:20.534643 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88d78bcd_3ac6_483c_8bb5_98c67ac49ae7.slice/crio-75617fd9535f5f9e24d1b3ea7358d2ce8a4e515ca75f407255b221a4fd25f938 WatchSource:0}: Error finding container 75617fd9535f5f9e24d1b3ea7358d2ce8a4e515ca75f407255b221a4fd25f938: Status 404 returned error can't find the container with id 75617fd9535f5f9e24d1b3ea7358d2ce8a4e515ca75f407255b221a4fd25f938 Jun 09 21:49:20.601532 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:20.601506 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-578796694c-t4dc7"] Jun 09 21:49:20.604764 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:20.604739 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcf8fcb_5d35_4997_a76c_2540d0803203.slice/crio-ccd35e2293144ad317f155e7db7370505c0bc20bfacf5380644f695f8f03c58a WatchSource:0}: Error finding container ccd35e2293144ad317f155e7db7370505c0bc20bfacf5380644f695f8f03c58a: Status 404 returned error can't find the container with id ccd35e2293144ad317f155e7db7370505c0bc20bfacf5380644f695f8f03c58a Jun 09 21:49:21.317645 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:21.317614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578796694c-t4dc7" event={"ID":"8dcf8fcb-5d35-4997-a76c-2540d0803203","Type":"ContainerStarted","Data":"63e397ea267754eab172da9e51c8bf51e763ace0b807b06ba3e19fe4d5074442"} Jun 09 21:49:21.318077 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:21.317658 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578796694c-t4dc7" event={"ID":"8dcf8fcb-5d35-4997-a76c-2540d0803203","Type":"ContainerStarted","Data":"ccd35e2293144ad317f155e7db7370505c0bc20bfacf5380644f695f8f03c58a"} Jun 09 21:49:21.318077 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:21.317723 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:49:21.319445 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:21.319426 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbfhc" event={"ID":"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7","Type":"ContainerStarted","Data":"1a84d6a89d08a615e8baabd8a0308a239fce6c04bf9b0cb6a2a752d8d1c91e49"} Jun 09 21:49:21.319507 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:21.319463 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbfhc" event={"ID":"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7","Type":"ContainerStarted","Data":"70713cd0a5ddd8aa658bb731bccbb43bb38117c65b2ce3153be2e96396bbe4d1"} Jun 09 21:49:21.319507 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:21.319481 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbfhc" event={"ID":"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7","Type":"ContainerStarted","Data":"75617fd9535f5f9e24d1b3ea7358d2ce8a4e515ca75f407255b221a4fd25f938"} Jun 09 21:49:21.335184 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:21.335146 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podStartSLOduration=1.3351341190000001 podStartE2EDuration="1.335134119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:21.333933555 +0000 UTC m=+232.198193057" watchObservedRunningTime="2026-06-09 21:49:21.335134119 +0000 UTC m=+232.199393620" Jun 09 21:49:23.328635 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:23.328591 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbfhc" event={"ID":"88d78bcd-3ac6-483c-8bb5-98c67ac49ae7","Type":"ContainerStarted","Data":"40cf62bfdd48933ba725a8a56f8d55df30a19b96e9579604073fd79db31f7d28"} Jun 09 21:49:23.344621 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:23.344574 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rbfhc" podStartSLOduration=1.260009201 podStartE2EDuration="3.344560133s" totalImagesPullingTime="2.084550932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 21:49:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:23.344163134 +0000 UTC m=+234.208422634" watchObservedRunningTime="2026-06-09 21:49:23.344560133 +0000 UTC m=+234.208819633" Jun 09 21:49:23.429769 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:23.429734 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:23.481989 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:23.481959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:25.026045 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:25.026010 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:25.077225 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:25.077195 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:25.630400 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:25.630368 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:25.679806 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:25.679777 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:25.952063 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:25.951982 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:26.052627 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:26.052597 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:26.372074 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:26.372044 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:26.473222 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:26.473192 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:26.573456 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:26.573426 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:26.800902 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:26.800824 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:26.874506 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:26.874462 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:26.950893 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:26.950860 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:27.550967 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:27.550939 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:27.651486 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:27.651451 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:27.995091 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:27.995055 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:28.094576 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:28.094544 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:28.433933 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:28.433900 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:28.479711 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:28.479682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:29.733782 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:29.733746 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" podUID="65e3c4a6-8966-44e8-9afd-6a38ebbb601d" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 21:49:29.734209 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:29.733824 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" Jun 09 21:49:29.734285 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:29.734256 2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"68487a6c6ae691d21cef000fc5e979341fe5bf8ab718d017d3eed9e8711e266c"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 21:49:29.734321 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:29.734303 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" podUID="65e3c4a6-8966-44e8-9afd-6a38ebbb601d" containerName="service-proxy" containerID="cri-o://68487a6c6ae691d21cef000fc5e979341fe5bf8ab718d017d3eed9e8711e266c" gracePeriod=30 Jun 09 21:49:30.352233 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:30.352202 2560 generic.go:356] "Generic (PLEG): container finished" podID="65e3c4a6-8966-44e8-9afd-6a38ebbb601d" containerID="68487a6c6ae691d21cef000fc5e979341fe5bf8ab718d017d3eed9e8711e266c" exitCode=2 Jun 09 21:49:30.352423 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:30.352239 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" event={"ID":"65e3c4a6-8966-44e8-9afd-6a38ebbb601d","Type":"ContainerDied","Data":"68487a6c6ae691d21cef000fc5e979341fe5bf8ab718d017d3eed9e8711e266c"} Jun 09 21:49:30.352423 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:30.352268 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6c5b7bc569-5zj5r" event={"ID":"65e3c4a6-8966-44e8-9afd-6a38ebbb601d","Type":"ContainerStarted","Data":"f399338fe97902ace58dad75ece1bfb8ef2fa996358638b3259efbaf9324c8b7"} Jun 09 21:49:31.004671 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:31.004637 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:31.055792 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:31.055762 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:31.193807 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:31.193773 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:32.847452 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:32.847418 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.111128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.111092 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.337574 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.337538 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.385898 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.385823 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4"] Jun 09 21:49:35.389101 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.389077 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.389223 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.389156 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sf6fk"] Jun 09 21:49:35.391523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.391502 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9526n\"" Jun 09 21:49:35.391523 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.391511 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 21:49:35.391695 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.391537 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 21:49:35.392261 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.392244 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 21:49:35.392328 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.392272 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.392437 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.392419 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 21:49:35.392502 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.392482 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 21:49:35.392615 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.392599 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 21:49:35.394352 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.394317 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 21:49:35.394660 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.394644 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 21:49:35.394743 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.394672 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 21:49:35.394904 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.394891 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nwngx\"" Jun 09 21:49:35.400787 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.400767 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4"] Jun 09 21:49:35.422929 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.422902 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.437275 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437243 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.437275 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437272 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437289 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqltk\" (UniqueName: \"kubernetes.io/projected/d85c9528-f44e-459b-a4dc-7f8d33887d5b-kube-api-access-rqltk\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437307 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10dca87c-3242-47b1-a3d9-dcf5e4305afc-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.437484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437375 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlk6m\" (UniqueName: \"kubernetes.io/projected/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-api-access-zlk6m\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.437484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437402 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-tls\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437422 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-textfile\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437438 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-root\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437811 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.437811 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437539 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-wtmp\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437811 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/10dca87c-3242-47b1-a3d9-dcf5e4305afc-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.437811 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.437811 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437632 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85c9528-f44e-459b-a4dc-7f8d33887d5b-metrics-client-ca\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.437811 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.437646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-sys\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.447497 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.447468 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bc5c6764b-fnjq2"] Jun 09 21:49:35.450422 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.450406 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.452799 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.452777 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 21:49:35.452898 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.452785 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 21:49:35.452964 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.452933 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 21:49:35.453024 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.452984 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 21:49:35.453085 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.453024 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9qzsm\"" Jun 09 21:49:35.453085 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.453042 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 21:49:35.453085 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.453059 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 21:49:35.453210 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.453116 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 21:49:35.458391 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.458370 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 21:49:35.463702 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.463682 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc5c6764b-fnjq2"] Jun 09 21:49:35.497029 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.496995 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.538429 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538398 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.538429 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538432 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85c9528-f44e-459b-a4dc-7f8d33887d5b-metrics-client-ca\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.538576 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538453 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-sys\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.538576 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538525 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-sys\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.538658 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538586 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.538658 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538622 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.538658 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538644 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqltk\" (UniqueName: \"kubernetes.io/projected/d85c9528-f44e-459b-a4dc-7f8d33887d5b-kube-api-access-rqltk\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.538836 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10dca87c-3242-47b1-a3d9-dcf5e4305afc-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.538836 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538695 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-service-ca\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.538940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538914 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-oauth-serving-cert\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.538994 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538947 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlk6m\" (UniqueName: \"kubernetes.io/projected/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-api-access-zlk6m\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.538994 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.538972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-tls\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.539093 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539001 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-serving-cert\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.539093 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539023 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-trusted-ca-bundle\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.539093 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539043 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d85c9528-f44e-459b-a4dc-7f8d33887d5b-metrics-client-ca\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.539093 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539052 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-textfile\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.539093 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539084 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.539274 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539127 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-oauth-config\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.539274 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-root\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.539274 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539176 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhvhs\" (UniqueName: \"kubernetes.io/projected/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-kube-api-access-rhvhs\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.539274 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539207 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-config\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.539274 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539243 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.539274 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539271 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-wtmp\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.539696 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539297 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/10dca87c-3242-47b1-a3d9-dcf5e4305afc-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.539696 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539397 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10dca87c-3242-47b1-a3d9-dcf5e4305afc-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.539696 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539409 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-root\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.539696 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/10dca87c-3242-47b1-a3d9-dcf5e4305afc-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.539696 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539652 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-textfile\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.540027 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539867 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-wtmp\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.540027 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.539954 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.540332 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.540297 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-accelerators-collector-config\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.541647 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.541618 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-tls\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.541733 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.541665 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d85c9528-f44e-459b-a4dc-7f8d33887d5b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.541733 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.541674 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.541733 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.541707 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.545877 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.545853 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqltk\" (UniqueName: \"kubernetes.io/projected/d85c9528-f44e-459b-a4dc-7f8d33887d5b-kube-api-access-rqltk\") pod \"node-exporter-sf6fk\" (UID: \"d85c9528-f44e-459b-a4dc-7f8d33887d5b\") " pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.546249 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.546227 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlk6m\" (UniqueName: \"kubernetes.io/projected/10dca87c-3242-47b1-a3d9-dcf5e4305afc-kube-api-access-zlk6m\") pod \"kube-state-metrics-57bbf8bfb5-g76s4\" (UID: \"10dca87c-3242-47b1-a3d9-dcf5e4305afc\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.600056 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.600008 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.639719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.639637 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-oauth-serving-cert\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.639719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.639674 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-serving-cert\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.639719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.639692 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-trusted-ca-bundle\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.639719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.639721 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-oauth-config\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.640120 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.639738 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhvhs\" (UniqueName: \"kubernetes.io/projected/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-kube-api-access-rhvhs\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.640120 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.639907 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-config\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.640120 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.640019 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-service-ca\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.640397 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.640375 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-oauth-serving-cert\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.640656 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.640589 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-config\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.640710 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.640667 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-trusted-ca-bundle\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.640710 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.640697 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-service-ca\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.642224 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.642203 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-oauth-config\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.642380 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.642361 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-serving-cert\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.646989 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.646966 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhvhs\" (UniqueName: \"kubernetes.io/projected/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-kube-api-access-rhvhs\") pod \"console-5bc5c6764b-fnjq2\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.697886 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.697862 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.698760 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.698741 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" Jun 09 21:49:35.704975 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.704960 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sf6fk" Jun 09 21:49:35.716052 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:35.716028 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd85c9528_f44e_459b_a4dc_7f8d33887d5b.slice/crio-84fa6c8379b9dc0ff45bb0234cfdafc3e470fe9fcb4419dbbb9a78f877de1d6d WatchSource:0}: Error finding container 84fa6c8379b9dc0ff45bb0234cfdafc3e470fe9fcb4419dbbb9a78f877de1d6d: Status 404 returned error can't find the container with id 84fa6c8379b9dc0ff45bb0234cfdafc3e470fe9fcb4419dbbb9a78f877de1d6d Jun 09 21:49:35.759680 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.759634 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:35.797733 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.797649 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:35.832107 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.832072 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4"] Jun 09 21:49:35.835071 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:35.835040 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10dca87c_3242_47b1_a3d9_dcf5e4305afc.slice/crio-b4c43070517d3b21fdf330202aeecd546daf713d685e983dc6c5b29882d3cac8 WatchSource:0}: Error finding container b4c43070517d3b21fdf330202aeecd546daf713d685e983dc6c5b29882d3cac8: Status 404 returned error can't find the container with id b4c43070517d3b21fdf330202aeecd546daf713d685e983dc6c5b29882d3cac8 Jun 09 21:49:35.894167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:35.894062 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bc5c6764b-fnjq2"] Jun 09 21:49:35.897706 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:35.897674 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc86c0bc_37ec_4b68_a3de_c5bfee905ddb.slice/crio-1e1b6a60b225bcd3417e29499ff6cd98608755e098edd03de825ad8eef23c536 WatchSource:0}: Error finding container 1e1b6a60b225bcd3417e29499ff6cd98608755e098edd03de825ad8eef23c536: Status 404 returned error can't find the container with id 1e1b6a60b225bcd3417e29499ff6cd98608755e098edd03de825ad8eef23c536 Jun 09 21:49:36.324039 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.323959 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:36.374765 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.374726 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf6fk" event={"ID":"d85c9528-f44e-459b-a4dc-7f8d33887d5b","Type":"ContainerStarted","Data":"84fa6c8379b9dc0ff45bb0234cfdafc3e470fe9fcb4419dbbb9a78f877de1d6d"} Jun 09 21:49:36.376306 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.376272 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" event={"ID":"10dca87c-3242-47b1-a3d9-dcf5e4305afc","Type":"ContainerStarted","Data":"b4c43070517d3b21fdf330202aeecd546daf713d685e983dc6c5b29882d3cac8"} Jun 09 21:49:36.377776 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.377745 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5c6764b-fnjq2" event={"ID":"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb","Type":"ContainerStarted","Data":"1e1b6a60b225bcd3417e29499ff6cd98608755e098edd03de825ad8eef23c536"} Jun 09 21:49:36.417599 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.417562 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:36.448102 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.445997 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 21:49:36.452623 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.452593 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.455162 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.455114 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 21:49:36.455491 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.455472 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 21:49:36.455950 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.455893 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 21:49:36.456207 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.456097 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6t49n\"" Jun 09 21:49:36.456207 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.456119 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 21:49:36.456441 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.456269 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 21:49:36.456441 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.456316 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 21:49:36.456576 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.456482 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 21:49:36.456576 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.456526 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 21:49:36.456740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.456724 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 21:49:36.461985 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.461963 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 21:49:36.482309 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.482275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:36.548492 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548440 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548675 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548506 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-web-config\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548675 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548555 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548675 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548620 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-config-out\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548675 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548675 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548673 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548956 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548722 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548956 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548745 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548956 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548773 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548956 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548868 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6rvg\" (UniqueName: \"kubernetes.io/projected/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-kube-api-access-w6rvg\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.548956 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548929 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.549211 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.548960 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.549211 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.549012 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.617667 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.617623 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:36.649940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.649912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6rvg\" (UniqueName: \"kubernetes.io/projected/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-kube-api-access-w6rvg\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650078 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.649963 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650078 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.649984 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650078 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650078 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650026 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650078 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650066 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-web-config\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650378 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650111 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650378 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650148 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-config-out\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650378 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650173 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650378 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650195 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.650378 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650222 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.652005 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.650973 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.652005 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.651027 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.652005 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.651660 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.652005 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.651723 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.652005 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.652002 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.655885 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.655840 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.656138 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.656094 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.656452 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.656429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-web-config\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.656875 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.656824 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-config-volume\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.657460 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.657416 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6rvg\" (UniqueName: \"kubernetes.io/projected/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-kube-api-access-w6rvg\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.658060 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.657921 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.658148 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.658113 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-config-out\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.659207 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.659179 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.659805 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.659759 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.660329 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.660283 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5f3ff4fd-007c-41eb-abe5-3ec20f7bb416-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:36.769100 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:36.768884 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 21:49:37.316211 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:37.316182 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 21:49:37.321215 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:37.320735 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3ff4fd_007c_41eb_abe5_3ec20f7bb416.slice/crio-1e3a86df4050c6e08c74a9db93b77bc54203dcabed0f8780d13d06f38b4f9c96 WatchSource:0}: Error finding container 1e3a86df4050c6e08c74a9db93b77bc54203dcabed0f8780d13d06f38b4f9c96: Status 404 returned error can't find the container with id 1e3a86df4050c6e08c74a9db93b77bc54203dcabed0f8780d13d06f38b4f9c96 Jun 09 21:49:37.386978 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:37.385846 2560 generic.go:356] "Generic (PLEG): container finished" podID="d85c9528-f44e-459b-a4dc-7f8d33887d5b" containerID="116fff9e88c401513ccc36b26cfc72b403747cba5fa984bbc326e4bad9e2ae40" exitCode=0 Jun 09 21:49:37.386978 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:37.385944 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf6fk" event={"ID":"d85c9528-f44e-459b-a4dc-7f8d33887d5b","Type":"ContainerDied","Data":"116fff9e88c401513ccc36b26cfc72b403747cba5fa984bbc326e4bad9e2ae40"} Jun 09 21:49:37.391600 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:37.391569 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" event={"ID":"10dca87c-3242-47b1-a3d9-dcf5e4305afc","Type":"ContainerStarted","Data":"44c2fab391fc57659588bd75a7a4ee19a597e7e0016566b3a13541132ae4db0b"} Jun 09 21:49:37.391722 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:37.391636 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" event={"ID":"10dca87c-3242-47b1-a3d9-dcf5e4305afc","Type":"ContainerStarted","Data":"f6c8c36ad6647fe56588e1b5e93115c66c3b38f78e357493dbf2465348aed708"} Jun 09 21:49:37.393135 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:37.393093 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerStarted","Data":"1e3a86df4050c6e08c74a9db93b77bc54203dcabed0f8780d13d06f38b4f9c96"} Jun 09 21:49:38.313981 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.313926 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:38.366588 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.366541 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:38.399238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.399204 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf6fk" event={"ID":"d85c9528-f44e-459b-a4dc-7f8d33887d5b","Type":"ContainerStarted","Data":"fa640ecabf46a52606f0c9cf53ed11b4cb56dbb52952778ad616ed53863cad03"} Jun 09 21:49:38.399711 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.399268 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sf6fk" event={"ID":"d85c9528-f44e-459b-a4dc-7f8d33887d5b","Type":"ContainerStarted","Data":"f7add295816adfedaf75dc2014ce2e653500e8d73d97e49a21c988f14475d252"} Jun 09 21:49:38.401702 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.401672 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" event={"ID":"10dca87c-3242-47b1-a3d9-dcf5e4305afc","Type":"ContainerStarted","Data":"9de614cc3c4fefa5aba98ee8c2e18e8abc0af1d0da47446d467253755a0c19f3"} Jun 09 21:49:38.417675 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.417624 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sf6fk" podStartSLOduration=2.413798352 podStartE2EDuration="3.417605384s" totalImagesPullingTime="917.929984ms" totalInitContainerRuntime="85.877048ms" isStatefulPod=true podCreationTimestamp="2026-06-09 21:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:38.41562684 +0000 UTC m=+249.279886344" watchObservedRunningTime="2026-06-09 21:49:38.417605384 +0000 UTC m=+249.281864885" Jun 09 21:49:38.431904 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.431854 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-g76s4" podStartSLOduration=2.072025305 podStartE2EDuration="3.43183802s" totalImagesPullingTime="1.359812715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:38.430982385 +0000 UTC m=+249.295241892" watchObservedRunningTime="2026-06-09 21:49:38.43183802 +0000 UTC m=+249.296097522" Jun 09 21:49:38.495461 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.495406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:38.877587 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:38.877552 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:39.406302 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.406260 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5c6764b-fnjq2" event={"ID":"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb","Type":"ContainerStarted","Data":"0988414a66055f4ffd394f1675ec1dbf96da39f89a872ce3b983f9f29c5d854c"} Jun 09 21:49:39.407723 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.407686 2560 generic.go:356] "Generic (PLEG): container finished" podID="5f3ff4fd-007c-41eb-abe5-3ec20f7bb416" containerID="30b8cd6d70a28abd70ff92c973f3723189e2934c52abc8c56b15732460561d0b" exitCode=0 Jun 09 21:49:39.407869 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.407771 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerDied","Data":"30b8cd6d70a28abd70ff92c973f3723189e2934c52abc8c56b15732460561d0b"} Jun 09 21:49:39.421960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.421913 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bc5c6764b-fnjq2" podStartSLOduration=1.142522022 podStartE2EDuration="4.421899106s" totalImagesPullingTime="3.279377084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:39.420370531 +0000 UTC m=+250.284630033" watchObservedRunningTime="2026-06-09 21:49:39.421899106 +0000 UTC m=+250.286158606" Jun 09 21:49:39.633696 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.633659 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:39.679170 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.679132 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-64bf88fc88-mg4wf"] Jun 09 21:49:39.684373 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.684332 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.686828 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.686805 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 21:49:39.686957 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.686806 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-68qlx\"" Jun 09 21:49:39.686957 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.686808 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 21:49:39.687500 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.687482 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-48q60879re0k9\"" Jun 09 21:49:39.687605 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.687504 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 21:49:39.687605 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.687574 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 21:49:39.692637 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.692615 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64bf88fc88-mg4wf"] Jun 09 21:49:39.695049 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.695030 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:39.777687 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.777643 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2a5be123-7461-4f36-b23f-d4779a9102d6-metrics-server-audit-profiles\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.777866 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.777697 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5be123-7461-4f36-b23f-d4779a9102d6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.777866 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.777758 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npt7j\" (UniqueName: \"kubernetes.io/projected/2a5be123-7461-4f36-b23f-d4779a9102d6-kube-api-access-npt7j\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.777866 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.777831 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-client-ca-bundle\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.777969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.777894 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2a5be123-7461-4f36-b23f-d4779a9102d6-audit-log\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.777969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.777918 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-secret-metrics-server-client-certs\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.777969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.777937 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-secret-metrics-server-tls\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879041 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879008 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5be123-7461-4f36-b23f-d4779a9102d6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879203 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879060 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npt7j\" (UniqueName: \"kubernetes.io/projected/2a5be123-7461-4f36-b23f-d4779a9102d6-kube-api-access-npt7j\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879203 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879092 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-client-ca-bundle\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879203 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879160 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2a5be123-7461-4f36-b23f-d4779a9102d6-audit-log\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879203 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879191 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-secret-metrics-server-client-certs\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879465 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879218 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-secret-metrics-server-tls\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879465 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879275 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2a5be123-7461-4f36-b23f-d4779a9102d6-metrics-server-audit-profiles\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879796 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879762 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2a5be123-7461-4f36-b23f-d4779a9102d6-audit-log\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.879932 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.879872 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a5be123-7461-4f36-b23f-d4779a9102d6-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.880257 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.880236 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2a5be123-7461-4f36-b23f-d4779a9102d6-metrics-server-audit-profiles\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.882360 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.882313 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-secret-metrics-server-tls\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.882486 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.882463 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-client-ca-bundle\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.882604 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.882587 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2a5be123-7461-4f36-b23f-d4779a9102d6-secret-metrics-server-client-certs\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.887823 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.887764 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npt7j\" (UniqueName: \"kubernetes.io/projected/2a5be123-7461-4f36-b23f-d4779a9102d6-kube-api-access-npt7j\") pod \"metrics-server-64bf88fc88-mg4wf\" (UID: \"2a5be123-7461-4f36-b23f-d4779a9102d6\") " pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:39.994145 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:39.994106 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:40.140512 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:40.140434 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-64bf88fc88-mg4wf"] Jun 09 21:49:40.142128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:40.142106 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:40.143917 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:40.143899 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5be123_7461_4f36_b23f_d4779a9102d6.slice/crio-9f3f088e0bd1a4bc21ef757d52fc0bdfe22498c9cf6898fac44e6a105baa712c WatchSource:0}: Error finding container 9f3f088e0bd1a4bc21ef757d52fc0bdfe22498c9cf6898fac44e6a105baa712c: Status 404 returned error can't find the container with id 9f3f088e0bd1a4bc21ef757d52fc0bdfe22498c9cf6898fac44e6a105baa712c Jun 09 21:49:40.194381 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:40.194319 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:40.413391 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:40.413262 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" event={"ID":"2a5be123-7461-4f36-b23f-d4779a9102d6","Type":"ContainerStarted","Data":"9f3f088e0bd1a4bc21ef757d52fc0bdfe22498c9cf6898fac44e6a105baa712c"} Jun 09 21:49:40.474580 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:40.474532 2560 patch_prober.go:28] interesting pod/image-registry-578796694c-t4dc7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:49:40.474762 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:40.474595 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:49:40.539600 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:40.539561 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:41.393907 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.393869 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:49:41.396547 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.396521 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9d90437-5a29-4e28-b396-61a3c8df3d57-metrics-certs\") pod \"network-metrics-daemon-f5fx7\" (UID: \"b9d90437-5a29-4e28-b396-61a3c8df3d57\") " pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:49:41.420609 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.420561 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerStarted","Data":"625d9b56412492b6c3c65e89a66ea235fb8e2ba4a91c279afdae2a41e9f72bcd"} Jun 09 21:49:41.420973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.420683 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerStarted","Data":"b16c4729c827729227e6023c1428c03e86ac54dee6c73787781f8be49bd35dde"} Jun 09 21:49:41.420973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.420713 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerStarted","Data":"4b356acaf16825226730b095f6f441658f24f9eb85aecd8ebaea0e5ef083f7f9"} Jun 09 21:49:41.420973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.420738 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerStarted","Data":"1330c00684d26a30692c85f695346c20aade82772a4757d948de2d6d85f581d1"} Jun 09 21:49:41.420973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.420776 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerStarted","Data":"8c48a0d98b74539a7cf3cc7e0994c29ffc3fba28e6f272b4fa94383d4bc1191b"} Jun 09 21:49:41.551930 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.551897 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:41.574462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.574429 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x5mcl\"" Jun 09 21:49:41.580937 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.580911 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f5fx7" Jun 09 21:49:41.798825 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:41.798791 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f5fx7"] Jun 09 21:49:41.801153 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:49:41.801124 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d90437_5a29_4e28_b396_61a3c8df3d57.slice/crio-6997093ffbd2dd521f87bdd7755298a3a81eb5f6003b43ed057e7dfa1ff2cb69 WatchSource:0}: Error finding container 6997093ffbd2dd521f87bdd7755298a3a81eb5f6003b43ed057e7dfa1ff2cb69: Status 404 returned error can't find the container with id 6997093ffbd2dd521f87bdd7755298a3a81eb5f6003b43ed057e7dfa1ff2cb69 Jun 09 21:49:42.329678 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:42.329644 2560 patch_prober.go:28] interesting pod/image-registry-578796694c-t4dc7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:49:42.329842 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:42.329702 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:49:42.429136 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:42.429098 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5f3ff4fd-007c-41eb-abe5-3ec20f7bb416","Type":"ContainerStarted","Data":"93ec386435a30f24a4c30884392f85d8df6fa26e8cc9a090fbaa66b2beb8afe2"} Jun 09 21:49:42.430984 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:42.430954 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" event={"ID":"2a5be123-7461-4f36-b23f-d4779a9102d6","Type":"ContainerStarted","Data":"edf5bdd6a422573a423c7150cc501ac6f0b1e860a616140bd47b803b83de7d09"} Jun 09 21:49:42.432215 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:42.432194 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5fx7" event={"ID":"b9d90437-5a29-4e28-b396-61a3c8df3d57","Type":"ContainerStarted","Data":"6997093ffbd2dd521f87bdd7755298a3a81eb5f6003b43ed057e7dfa1ff2cb69"} Jun 09 21:49:42.453128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:42.453075 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.233469687 podStartE2EDuration="6.45305654s" totalImagesPullingTime="4.200530696s" totalInitContainerRuntime="19.056157ms" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:42.451679099 +0000 UTC m=+253.315938613" watchObservedRunningTime="2026-06-09 21:49:42.45305654 +0000 UTC m=+253.317316044" Jun 09 21:49:42.470016 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:42.469965 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" podStartSLOduration=1.8905454289999999 podStartE2EDuration="3.469947893s" totalImagesPullingTime="1.579402464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:42.468708445 +0000 UTC m=+253.332967949" watchObservedRunningTime="2026-06-09 21:49:42.469947893 +0000 UTC m=+253.334207393" Jun 09 21:49:43.437204 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:43.437161 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5fx7" event={"ID":"b9d90437-5a29-4e28-b396-61a3c8df3d57","Type":"ContainerStarted","Data":"4b98ef5b85dde10761b269b656bec83f65befae3c3e19e2861bafec22fc60b64"} Jun 09 21:49:43.437592 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:43.437241 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f5fx7" event={"ID":"b9d90437-5a29-4e28-b396-61a3c8df3d57","Type":"ContainerStarted","Data":"7e7435ce5f9e9791bfe0420648a5db8ac3f6b4efb892004aaa9de7b9e6e51e91"} Jun 09 21:49:43.451652 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:43.451606 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f5fx7" podStartSLOduration=253.587349353 podStartE2EDuration="4m14.451592393s" totalImagesPullingTime="864.24304ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:45:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:49:43.45071798 +0000 UTC m=+254.314977483" watchObservedRunningTime="2026-06-09 21:49:43.451592393 +0000 UTC m=+254.315851893" Jun 09 21:49:43.529170 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:43.529138 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:43.579040 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:43.578990 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:43.834615 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:43.834528 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:43.935721 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:43.935690 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:44.845095 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:44.845063 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:44.946575 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:44.946542 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:45.760437 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:45.760395 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:45.760623 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:45.760455 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:49:45.761803 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:45.761778 2560 patch_prober.go:28] interesting pod/console-5bc5c6764b-fnjq2 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 09 21:49:45.761907 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:45.761821 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bc5c6764b-fnjq2" podUID="fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 09 21:49:47.242687 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:47.242651 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:47.293741 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:47.293710 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:49.085739 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:49.085694 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc5c6764b-fnjq2"] Jun 09 21:49:50.472887 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:50.472856 2560 patch_prober.go:28] interesting pod/image-registry-578796694c-t4dc7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:49:50.473244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:50.472903 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:49:52.329532 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:52.329498 2560 patch_prober.go:28] interesting pod/image-registry-578796694c-t4dc7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:49:52.329895 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:52.329551 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:49:55.102756 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:55.102727 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:55.147371 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:55.147319 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:56.870710 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:56.870675 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:56.921109 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:56.921079 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:49:59.994422 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:59.994375 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:49:59.994809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:49:59.994455 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:50:00.472055 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:00.472026 2560 patch_prober.go:28] interesting pod/image-registry-578796694c-t4dc7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:50:00.472327 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:00.472105 2560 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:50:00.472327 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:00.472150 2560 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:50:00.472684 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:00.472645 2560 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"63e397ea267754eab172da9e51c8bf51e763ace0b807b06ba3e19fe4d5074442"} pod="openshift-image-registry/image-registry-578796694c-t4dc7" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 21:50:00.476160 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:00.476133 2560 patch_prober.go:28] interesting pod/image-registry-578796694c-t4dc7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:50:00.476263 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:00.476187 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:50:06.355263 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:06.355225 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:06.406579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:06.406551 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:10.476894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:10.476855 2560 patch_prober.go:28] interesting pod/image-registry-578796694c-t4dc7 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 21:50:10.477256 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:10.476911 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:50:11.111454 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:50:11.111406 2560 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pqkwv" podUID="d58b3cb4-2a60-4e55-8507-6b990274c90a" Jun 09 21:50:11.533283 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:11.533195 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqkwv" Jun 09 21:50:14.105780 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.105721 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bc5c6764b-fnjq2" podUID="fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" containerName="console" containerID="cri-o://0988414a66055f4ffd394f1675ec1dbf96da39f89a872ce3b983f9f29c5d854c" gracePeriod=15 Jun 09 21:50:14.480866 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.480834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:50:14.483389 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.483323 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d58b3cb4-2a60-4e55-8507-6b990274c90a-metrics-tls\") pod \"dns-default-pqkwv\" (UID: \"d58b3cb4-2a60-4e55-8507-6b990274c90a\") " pod="openshift-dns/dns-default-pqkwv" Jun 09 21:50:14.535642 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.535621 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qwpdx\"" Jun 09 21:50:14.543977 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.543951 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pqkwv" Jun 09 21:50:14.545836 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.545790 2560 generic.go:356] "Generic (PLEG): container finished" podID="fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" containerID="0988414a66055f4ffd394f1675ec1dbf96da39f89a872ce3b983f9f29c5d854c" exitCode=0 Jun 09 21:50:14.545898 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.545832 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5c6764b-fnjq2" event={"ID":"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb","Type":"ContainerDied","Data":"0988414a66055f4ffd394f1675ec1dbf96da39f89a872ce3b983f9f29c5d854c"} Jun 09 21:50:14.545952 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.545924 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bc5c6764b-fnjq2" event={"ID":"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb","Type":"ContainerDied","Data":"1e1b6a60b225bcd3417e29499ff6cd98608755e098edd03de825ad8eef23c536"} Jun 09 21:50:14.545996 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.545953 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e1b6a60b225bcd3417e29499ff6cd98608755e098edd03de825ad8eef23c536" Jun 09 21:50:14.547698 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.547682 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:50:14.672402 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.672214 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pqkwv"] Jun 09 21:50:14.674875 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:50:14.674848 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58b3cb4_2a60_4e55_8507_6b990274c90a.slice/crio-740d656b726ce37e4a912f9a0661b7797c92afc06e911bc0a0c5c37b00fc87e1 WatchSource:0}: Error finding container 740d656b726ce37e4a912f9a0661b7797c92afc06e911bc0a0c5c37b00fc87e1: Status 404 returned error can't find the container with id 740d656b726ce37e4a912f9a0661b7797c92afc06e911bc0a0c5c37b00fc87e1 Jun 09 21:50:14.682594 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.682549 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-oauth-config\") pod \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " Jun 09 21:50:14.682690 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.682650 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-config\") pod \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " Jun 09 21:50:14.682690 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.682679 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-trusted-ca-bundle\") pod \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " Jun 09 21:50:14.682796 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.682719 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-service-ca\") pod \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " Jun 09 21:50:14.682865 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.682844 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhvhs\" (UniqueName: \"kubernetes.io/projected/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-kube-api-access-rhvhs\") pod \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " Jun 09 21:50:14.682917 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.682902 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-oauth-serving-cert\") pod \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " Jun 09 21:50:14.682967 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.682937 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-serving-cert\") pod \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\" (UID: \"fc86c0bc-37ec-4b68-a3de-c5bfee905ddb\") " Jun 09 21:50:14.683139 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.683094 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-config" (OuterVolumeSpecName: "console-config") pod "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" (UID: "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:14.683139 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.683103 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-service-ca" (OuterVolumeSpecName: "service-ca") pod "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" (UID: "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:14.683139 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.683109 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" (UID: "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:14.683298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.683194 2560 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.683298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.683212 2560 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-trusted-ca-bundle\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.683298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.683231 2560 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-service-ca\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.683676 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.683653 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" (UID: "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:50:14.685014 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.684988 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" (UID: "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:50:14.685102 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.685016 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-kube-api-access-rhvhs" (OuterVolumeSpecName: "kube-api-access-rhvhs") pod "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" (UID: "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb"). InnerVolumeSpecName "kube-api-access-rhvhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:50:14.685102 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.685053 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" (UID: "fc86c0bc-37ec-4b68-a3de-c5bfee905ddb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 21:50:14.783958 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.783921 2560 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-oauth-config\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.783958 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.783951 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhvhs\" (UniqueName: \"kubernetes.io/projected/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-kube-api-access-rhvhs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.783958 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.783962 2560 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-oauth-serving-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:50:14.784196 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:14.783970 2560 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb-console-serving-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:50:15.460935 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.460894 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/init-config-reloader/0.log" Jun 09 21:50:15.550977 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.550941 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqkwv" event={"ID":"d58b3cb4-2a60-4e55-8507-6b990274c90a","Type":"ContainerStarted","Data":"740d656b726ce37e4a912f9a0661b7797c92afc06e911bc0a0c5c37b00fc87e1"} Jun 09 21:50:15.552251 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.552232 2560 generic.go:356] "Generic (PLEG): container finished" podID="483151ca-20ab-4d36-a8de-852eeeb2ee8b" containerID="f4dbbd5e94bd0a8c055f5e94c9506ed0ed3c28b70300cd97a1b165a58c6e7228" exitCode=0 Jun 09 21:50:15.552328 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.552308 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" event={"ID":"483151ca-20ab-4d36-a8de-852eeeb2ee8b","Type":"ContainerDied","Data":"f4dbbd5e94bd0a8c055f5e94c9506ed0ed3c28b70300cd97a1b165a58c6e7228"} Jun 09 21:50:15.552393 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.552364 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bc5c6764b-fnjq2" Jun 09 21:50:15.552779 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.552762 2560 scope.go:117] "RemoveContainer" containerID="f4dbbd5e94bd0a8c055f5e94c9506ed0ed3c28b70300cd97a1b165a58c6e7228" Jun 09 21:50:15.581778 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.581729 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bc5c6764b-fnjq2"] Jun 09 21:50:15.589236 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.589195 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bc5c6764b-fnjq2"] Jun 09 21:50:15.660290 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.660216 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/alertmanager/0.log" Jun 09 21:50:15.798100 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.798050 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:15.844128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.844091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:15.859834 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:15.859807 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/config-reloader/0.log" Jun 09 21:50:16.061152 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.061054 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/kube-rbac-proxy-web/0.log" Jun 09 21:50:16.259703 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.259640 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/kube-rbac-proxy/0.log" Jun 09 21:50:16.460253 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.460222 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/kube-rbac-proxy-metric/0.log" Jun 09 21:50:16.557487 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.557443 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqkwv" event={"ID":"d58b3cb4-2a60-4e55-8507-6b990274c90a","Type":"ContainerStarted","Data":"3916d0306d6ff3edee9e179851ee1f2ed5145f457a3cd1e706e99e20a08293f2"} Jun 09 21:50:16.557949 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.557508 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pqkwv" event={"ID":"d58b3cb4-2a60-4e55-8507-6b990274c90a","Type":"ContainerStarted","Data":"f6c0ae84118226fc25763061d97cf58964776b7a3e962c34e3691b10a198fab6"} Jun 09 21:50:16.557949 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.557559 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pqkwv" Jun 09 21:50:16.559291 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.559268 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-zrjsn" event={"ID":"483151ca-20ab-4d36-a8de-852eeeb2ee8b","Type":"ContainerStarted","Data":"fbc2ba6ceb0c5827f59be1ba221d72d8ca9f890663d71a8586e6a1127ff8a3f5"} Jun 09 21:50:16.573998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.573911 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pqkwv" podStartSLOduration=251.075871162 podStartE2EDuration="4m12.573892532s" totalImagesPullingTime="1.49802137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:50:16.572538221 +0000 UTC m=+287.436797722" watchObservedRunningTime="2026-06-09 21:50:16.573892532 +0000 UTC m=+287.438152034" Jun 09 21:50:16.660574 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:16.660534 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/prom-label-proxy/0.log" Jun 09 21:50:17.061636 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:17.061606 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g76s4_10dca87c-3242-47b1-a3d9-dcf5e4305afc/kube-state-metrics/0.log" Jun 09 21:50:17.260512 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:17.260481 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g76s4_10dca87c-3242-47b1-a3d9-dcf5e4305afc/kube-rbac-proxy-main/0.log" Jun 09 21:50:17.460635 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:17.460599 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g76s4_10dca87c-3242-47b1-a3d9-dcf5e4305afc/kube-rbac-proxy-self/0.log" Jun 09 21:50:17.574690 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:17.574654 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" path="/var/lib/kubelet/pods/fc86c0bc-37ec-4b68-a3de-c5bfee905ddb/volumes" Jun 09 21:50:17.660785 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:17.660742 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64bf88fc88-mg4wf_2a5be123-7461-4f36-b23f-d4779a9102d6/metrics-server/0.log" Jun 09 21:50:19.260162 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:19.260133 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf6fk_d85c9528-f44e-459b-a4dc-7f8d33887d5b/init-textfile/0.log" Jun 09 21:50:19.461261 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:19.461216 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf6fk_d85c9528-f44e-459b-a4dc-7f8d33887d5b/node-exporter/0.log" Jun 09 21:50:19.607963 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:19.607932 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:19.659820 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:19.659793 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf6fk_d85c9528-f44e-459b-a4dc-7f8d33887d5b/kube-rbac-proxy/0.log" Jun 09 21:50:19.708655 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:19.708626 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:19.809153 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:19.809110 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:19.854655 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:19.854625 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:20.000098 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:20.000021 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:50:20.003848 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:20.003825 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-64bf88fc88-mg4wf" Jun 09 21:50:20.111772 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:20.111738 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:20.477018 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:20.476991 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:50:20.592685 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:20.592636 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:20.641685 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:20.641646 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:20.966647 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:20.966612 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:21.016507 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:21.016477 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:25.492493 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:25.492443 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-578796694c-t4dc7" podUID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerName="registry" containerID="cri-o://63e397ea267754eab172da9e51c8bf51e763ace0b807b06ba3e19fe4d5074442" gracePeriod=30 Jun 09 21:50:26.261001 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:26.260973 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqkwv_d58b3cb4-2a60-4e55-8507-6b990274c90a/dns/0.log" Jun 09 21:50:26.460919 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:26.460892 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqkwv_d58b3cb4-2a60-4e55-8507-6b990274c90a/kube-rbac-proxy/0.log" Jun 09 21:50:26.565650 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:26.565623 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pqkwv" Jun 09 21:50:26.668555 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:26.668529 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:27.061297 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:27.061266 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-64jmm_12f9b2cc-1ce0-44fb-94ee-53043fe84a28/dns-node-resolver/0.log" Jun 09 21:50:27.600815 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:27.600780 2560 generic.go:356] "Generic (PLEG): container finished" podID="8dcf8fcb-5d35-4997-a76c-2540d0803203" containerID="63e397ea267754eab172da9e51c8bf51e763ace0b807b06ba3e19fe4d5074442" exitCode=0 Jun 09 21:50:27.601253 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:27.600865 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578796694c-t4dc7" event={"ID":"8dcf8fcb-5d35-4997-a76c-2540d0803203","Type":"ContainerDied","Data":"63e397ea267754eab172da9e51c8bf51e763ace0b807b06ba3e19fe4d5074442"} Jun 09 21:50:27.601253 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:27.600907 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-578796694c-t4dc7" event={"ID":"8dcf8fcb-5d35-4997-a76c-2540d0803203","Type":"ContainerStarted","Data":"fe110ce28c242a1437759527c5879c93967f073cdac09835d917c960460f4a7f"} Jun 09 21:50:27.601253 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:27.601008 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:50:27.659998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:27.659972 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-578796694c-t4dc7_8dcf8fcb-5d35-4997-a76c-2540d0803203/registry/1.log" Jun 09 21:50:27.951257 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:27.951171 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:28.000947 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:28.000915 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:28.060071 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:28.060042 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hdcz_e0390187-24cc-4edb-88ee-be4e2acebaba/node-ca/0.log" Jun 09 21:50:28.173138 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:28.173100 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:28.226200 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:28.226114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:29.060387 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:29.060332 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lzqkt_1ed86f98-98e1-4d01-81c3-55d4594957e6/serve-healthcheck-canary/0.log" Jun 09 21:50:29.522319 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:29.522288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:50:29.522795 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:29.522771 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:50:29.529701 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:29.529682 2560 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 21:50:33.443305 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:33.443270 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:33.543561 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:33.543533 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:37.597294 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:37.597259 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:37.697972 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:37.697946 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:42.433240 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:42.433199 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:42.534020 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:42.533985 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:43.172358 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:43.172300 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:43.231691 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:43.231659 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:44.694499 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:44.694472 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:44.771469 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:44.771440 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:44.828635 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:44.828600 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:48.613195 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:48.613165 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-578796694c-t4dc7" Jun 09 21:50:48.785768 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:48.785737 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:48.886299 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:48.886217 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:51.437064 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:51.437027 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:51.493393 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:51.493354 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:58.177258 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:58.177218 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:50:58.229157 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:50:58.229122 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:04.706561 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:04.706529 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:04.804235 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:04.804198 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:06.350423 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:06.350391 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:06.403953 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:06.403923 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:13.180661 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:13.180577 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:13.282319 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:13.282281 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:17.461520 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:17.461484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:17.506469 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:17.506439 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:43.386273 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:43.386235 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:53.366782 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:53.366741 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:51:53.466417 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:51:53.466381 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:19.651114 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:19.651078 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:21.204530 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:21.204496 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:23.068754 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:23.068716 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:23.169847 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:23.169810 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:24.915988 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:24.915953 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:25.030310 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:25.030275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:25.232064 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:25.231982 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:25.324159 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:25.324126 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:28.702966 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:28.702921 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:29.086930 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:29.086849 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:30.050946 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:30.050909 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:30.104470 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:30.104433 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:32.881614 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.881581 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx"] Jun 09 21:52:32.881983 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.881831 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" containerName="console" Jun 09 21:52:32.881983 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.881841 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" containerName="console" Jun 09 21:52:32.881983 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.881907 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc86c0bc-37ec-4b68-a3de-c5bfee905ddb" containerName="console" Jun 09 21:52:32.884686 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.884668 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:32.887311 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.887293 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 21:52:32.887457 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.887426 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 21:52:32.888389 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.888372 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-f8wvp\"" Jun 09 21:52:32.894577 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:32.894557 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx"] Jun 09 21:52:33.055413 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.055380 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtq5g\" (UniqueName: \"kubernetes.io/projected/24a6541e-bbae-49c1-82ee-8d48aad48865-kube-api-access-qtq5g\") pod \"cert-manager-cainjector-5d99449ffd-5hwmx\" (UID: \"24a6541e-bbae-49c1-82ee-8d48aad48865\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:33.055580 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.055478 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24a6541e-bbae-49c1-82ee-8d48aad48865-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5hwmx\" (UID: \"24a6541e-bbae-49c1-82ee-8d48aad48865\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:33.156789 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.156698 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtq5g\" (UniqueName: \"kubernetes.io/projected/24a6541e-bbae-49c1-82ee-8d48aad48865-kube-api-access-qtq5g\") pod \"cert-manager-cainjector-5d99449ffd-5hwmx\" (UID: \"24a6541e-bbae-49c1-82ee-8d48aad48865\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:33.156789 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.156780 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24a6541e-bbae-49c1-82ee-8d48aad48865-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5hwmx\" (UID: \"24a6541e-bbae-49c1-82ee-8d48aad48865\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:33.164175 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.164154 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/24a6541e-bbae-49c1-82ee-8d48aad48865-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-5hwmx\" (UID: \"24a6541e-bbae-49c1-82ee-8d48aad48865\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:33.164378 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.164354 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtq5g\" (UniqueName: \"kubernetes.io/projected/24a6541e-bbae-49c1-82ee-8d48aad48865-kube-api-access-qtq5g\") pod \"cert-manager-cainjector-5d99449ffd-5hwmx\" (UID: \"24a6541e-bbae-49c1-82ee-8d48aad48865\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:33.194708 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.194675 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" Jun 09 21:52:33.326696 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.326654 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx"] Jun 09 21:52:33.329496 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:52:33.329468 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24a6541e_bbae_49c1_82ee_8d48aad48865.slice/crio-bdfcd026d11ebdafc5a6833d42152ec546a854fce37bd8d45d893dd91fe6da78 WatchSource:0}: Error finding container bdfcd026d11ebdafc5a6833d42152ec546a854fce37bd8d45d893dd91fe6da78: Status 404 returned error can't find the container with id bdfcd026d11ebdafc5a6833d42152ec546a854fce37bd8d45d893dd91fe6da78 Jun 09 21:52:33.336363 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:33.336319 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 21:52:34.056361 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:34.056272 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" event={"ID":"24a6541e-bbae-49c1-82ee-8d48aad48865","Type":"ContainerStarted","Data":"bdfcd026d11ebdafc5a6833d42152ec546a854fce37bd8d45d893dd91fe6da78"} Jun 09 21:52:34.178694 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:34.178653 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:36.091258 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:36.091220 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:37.056761 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:37.056728 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:37.070670 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:37.070642 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" event={"ID":"24a6541e-bbae-49c1-82ee-8d48aad48865","Type":"ContainerStarted","Data":"3c019139251f2bcee2e37a79b162a2fe564fb6c1b7a333549fdd211e8394effd"} Jun 09 21:52:37.087241 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:37.087189 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-5hwmx" podStartSLOduration=1.94881006 podStartE2EDuration="5.087176391s" totalImagesPullingTime="3.138366331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:52:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:52:37.086198267 +0000 UTC m=+427.950457769" watchObservedRunningTime="2026-06-09 21:52:37.087176391 +0000 UTC m=+427.951435892" Jun 09 21:52:37.156759 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:37.156717 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:43.286172 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:43.286078 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:43.384831 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:43.384791 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:45.470813 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:45.470778 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:50.911746 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:50.911681 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:55.752049 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:55.752008 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:55.852925 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:55.852890 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:57.071125 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.071094 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:57.169158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.169107 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:57.684027 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.683978 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:57.865685 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.865643 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:57.966418 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.966282 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:57.988347 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.988304 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf"] Jun 09 21:52:57.991575 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.991555 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:57.993985 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.993964 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 21:52:57.994166 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.994047 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-b7gx5\"" Jun 09 21:52:57.994439 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.994421 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 21:52:57.994566 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.994507 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 21:52:57.994655 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:57.994640 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 21:52:58.013565 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.013541 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf"] Jun 09 21:52:58.050379 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.050328 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40153260-cb04-458e-a064-6e58683943fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.050579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.050391 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40153260-cb04-458e-a064-6e58683943fc-tmp\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.050579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.050448 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40153260-cb04-458e-a064-6e58683943fc-manifests\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.050579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.050488 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpnsr\" (UniqueName: \"kubernetes.io/projected/40153260-cb04-458e-a064-6e58683943fc-kube-api-access-rpnsr\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.050579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.050518 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40153260-cb04-458e-a064-6e58683943fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.120443 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.120404 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:58.151360 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.151306 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40153260-cb04-458e-a064-6e58683943fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.151509 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.151365 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40153260-cb04-458e-a064-6e58683943fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.151509 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.151395 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40153260-cb04-458e-a064-6e58683943fc-tmp\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.151509 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.151446 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40153260-cb04-458e-a064-6e58683943fc-manifests\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.151509 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.151480 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpnsr\" (UniqueName: \"kubernetes.io/projected/40153260-cb04-458e-a064-6e58683943fc-kube-api-access-rpnsr\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.151909 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.151876 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40153260-cb04-458e-a064-6e58683943fc-manifests\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.153775 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.153739 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40153260-cb04-458e-a064-6e58683943fc-tmp\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.154007 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.153988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40153260-cb04-458e-a064-6e58683943fc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.154072 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.153988 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40153260-cb04-458e-a064-6e58683943fc-webhook-cert\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.161166 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.161131 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpnsr\" (UniqueName: \"kubernetes.io/projected/40153260-cb04-458e-a064-6e58683943fc-kube-api-access-rpnsr\") pod \"opendatahub-operator-controller-manager-96bcfd894-mjvxf\" (UID: \"40153260-cb04-458e-a064-6e58683943fc\") " pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.226212 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.226125 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:58.302378 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.302326 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:52:58.321290 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.321257 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:58.424404 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.424287 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:58.461765 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.461732 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf"] Jun 09 21:52:58.465906 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:52:58.465884 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40153260_cb04_458e_a064_6e58683943fc.slice/crio-d6f74487eb136a5d0a9b1e4fced1bb487348f59a6f399fea8b9e870c8f8a5ca5 WatchSource:0}: Error finding container d6f74487eb136a5d0a9b1e4fced1bb487348f59a6f399fea8b9e870c8f8a5ca5: Status 404 returned error can't find the container with id d6f74487eb136a5d0a9b1e4fced1bb487348f59a6f399fea8b9e870c8f8a5ca5 Jun 09 21:52:58.531951 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.531876 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:58.620884 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:58.620853 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:52:59.154331 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:52:59.154287 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" event={"ID":"40153260-cb04-458e-a064-6e58683943fc","Type":"ContainerStarted","Data":"d6f74487eb136a5d0a9b1e4fced1bb487348f59a6f399fea8b9e870c8f8a5ca5"} Jun 09 21:53:02.167981 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:02.167942 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" event={"ID":"40153260-cb04-458e-a064-6e58683943fc","Type":"ContainerStarted","Data":"c7d09e38cb2cae5cac1fe105500ae9fc25cf013687f36823d00dfa0df67ed554"} Jun 09 21:53:03.173164 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:03.173128 2560 generic.go:356] "Generic (PLEG): container finished" podID="40153260-cb04-458e-a064-6e58683943fc" containerID="c7d09e38cb2cae5cac1fe105500ae9fc25cf013687f36823d00dfa0df67ed554" exitCode=0 Jun 09 21:53:03.173561 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:03.173188 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" event={"ID":"40153260-cb04-458e-a064-6e58683943fc","Type":"ContainerDied","Data":"c7d09e38cb2cae5cac1fe105500ae9fc25cf013687f36823d00dfa0df67ed554"} Jun 09 21:53:04.178601 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:04.178562 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" event={"ID":"40153260-cb04-458e-a064-6e58683943fc","Type":"ContainerStarted","Data":"611d1799f67d629c67d3ddfe6f7df18f4b3056a8d74cffc0552717f1536d91a1"} Jun 09 21:53:04.178979 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:04.178683 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:53:04.198063 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:04.198014 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" podStartSLOduration=2.780783648 podStartE2EDuration="7.197997556s" totalImagesPullingTime="3.426130893s" totalInitContainerRuntime="991.083015ms" isStatefulPod=false podCreationTimestamp="2026-06-09 21:52:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:04.196496992 +0000 UTC m=+455.060756493" watchObservedRunningTime="2026-06-09 21:53:04.197997556 +0000 UTC m=+455.062257059" Jun 09 21:53:15.184261 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:15.184233 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-96bcfd894-mjvxf" Jun 09 21:53:16.776616 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:16.776579 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:16.899426 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:16.899396 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.118375 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.118333 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.210060 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.210020 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.315383 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.315328 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.461826 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.461723 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl"] Jun 09 21:53:17.464825 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.464805 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.467206 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.467185 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 21:53:17.467322 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.467194 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 21:53:17.467414 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.467280 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 21:53:17.468019 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.468003 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 21:53:17.468087 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.468005 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kzkmp\"" Jun 09 21:53:17.475104 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.475085 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl"] Jun 09 21:53:17.540619 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.540576 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.547747 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.547720 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-798gj"] Jun 09 21:53:17.550701 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.550686 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:17.552798 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.552778 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 21:53:17.552909 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.552784 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mbc9t\"" Jun 09 21:53:17.559861 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.559840 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-798gj"] Jun 09 21:53:17.611602 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.611572 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60903d5c-2083-4e9b-bbe1-c77b22461f4a-tmp\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.611769 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.611621 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-cert\") pod \"odh-model-controller-6dc94f689f-798gj\" (UID: \"fc5c3da3-dfb2-453c-b275-22f9f590c1bd\") " pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:17.611769 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.611640 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60903d5c-2083-4e9b-bbe1-c77b22461f4a-tls-certs\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.611769 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.611658 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn6x5\" (UniqueName: \"kubernetes.io/projected/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-kube-api-access-rn6x5\") pod \"odh-model-controller-6dc94f689f-798gj\" (UID: \"fc5c3da3-dfb2-453c-b275-22f9f590c1bd\") " pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:17.611769 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.611689 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfncs\" (UniqueName: \"kubernetes.io/projected/60903d5c-2083-4e9b-bbe1-c77b22461f4a-kube-api-access-dfncs\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.636478 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.636441 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.712914 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.712834 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60903d5c-2083-4e9b-bbe1-c77b22461f4a-tmp\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.712914 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.712878 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-cert\") pod \"odh-model-controller-6dc94f689f-798gj\" (UID: \"fc5c3da3-dfb2-453c-b275-22f9f590c1bd\") " pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:17.712914 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.712895 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60903d5c-2083-4e9b-bbe1-c77b22461f4a-tls-certs\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.712914 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.712912 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn6x5\" (UniqueName: \"kubernetes.io/projected/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-kube-api-access-rn6x5\") pod \"odh-model-controller-6dc94f689f-798gj\" (UID: \"fc5c3da3-dfb2-453c-b275-22f9f590c1bd\") " pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:17.713223 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.712934 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfncs\" (UniqueName: \"kubernetes.io/projected/60903d5c-2083-4e9b-bbe1-c77b22461f4a-kube-api-access-dfncs\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.713223 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:53:17.713008 2560 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 21:53:17.713223 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:53:17.713075 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-cert podName:fc5c3da3-dfb2-453c-b275-22f9f590c1bd nodeName:}" failed. No retries permitted until 2026-06-09 21:53:18.213055125 +0000 UTC m=+469.077314604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-cert") pod "odh-model-controller-6dc94f689f-798gj" (UID: "fc5c3da3-dfb2-453c-b275-22f9f590c1bd") : secret "odh-model-controller-webhook-cert" not found Jun 09 21:53:17.715277 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.715252 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60903d5c-2083-4e9b-bbe1-c77b22461f4a-tmp\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.715385 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.715331 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60903d5c-2083-4e9b-bbe1-c77b22461f4a-tls-certs\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.735670 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.735638 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn6x5\" (UniqueName: \"kubernetes.io/projected/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-kube-api-access-rn6x5\") pod \"odh-model-controller-6dc94f689f-798gj\" (UID: \"fc5c3da3-dfb2-453c-b275-22f9f590c1bd\") " pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:17.735854 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.735830 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfncs\" (UniqueName: \"kubernetes.io/projected/60903d5c-2083-4e9b-bbe1-c77b22461f4a-kube-api-access-dfncs\") pod \"kube-auth-proxy-6d56bf64cc-n4ssl\" (UID: \"60903d5c-2083-4e9b-bbe1-c77b22461f4a\") " pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.746022 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.745989 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.774786 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.774764 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" Jun 09 21:53:17.850238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.850208 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:17.903984 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:17.903959 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl"] Jun 09 21:53:17.906043 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:17.906016 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60903d5c_2083_4e9b_bbe1_c77b22461f4a.slice/crio-b6789627c40d61fc3ca5f4b13b0af850347f7d3f9d0c9870dbb1545e011da445 WatchSource:0}: Error finding container b6789627c40d61fc3ca5f4b13b0af850347f7d3f9d0c9870dbb1545e011da445: Status 404 returned error can't find the container with id b6789627c40d61fc3ca5f4b13b0af850347f7d3f9d0c9870dbb1545e011da445 Jun 09 21:53:18.123835 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.123800 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:18.126836 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.126810 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-299rn"] Jun 09 21:53:18.130929 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.130914 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:18.133027 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.133010 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 21:53:18.133118 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.133029 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6ddjr\"" Jun 09 21:53:18.141253 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.141228 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-299rn"] Jun 09 21:53:18.218007 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.217972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-cert\") pod \"odh-model-controller-6dc94f689f-798gj\" (UID: \"fc5c3da3-dfb2-453c-b275-22f9f590c1bd\") " pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:18.218007 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.218015 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b0681c1-736d-4060-a145-3010b4f553b7-tls-certs\") pod \"model-serving-api-5dd488fc48-299rn\" (UID: \"6b0681c1-736d-4060-a145-3010b4f553b7\") " pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:18.218258 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.218040 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pk8w\" (UniqueName: \"kubernetes.io/projected/6b0681c1-736d-4060-a145-3010b4f553b7-kube-api-access-5pk8w\") pod \"model-serving-api-5dd488fc48-299rn\" (UID: \"6b0681c1-736d-4060-a145-3010b4f553b7\") " pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:18.220584 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.220560 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc5c3da3-dfb2-453c-b275-22f9f590c1bd-cert\") pod \"odh-model-controller-6dc94f689f-798gj\" (UID: \"fc5c3da3-dfb2-453c-b275-22f9f590c1bd\") " pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:18.225718 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.221775 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:18.232932 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.232905 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" event={"ID":"60903d5c-2083-4e9b-bbe1-c77b22461f4a","Type":"ContainerStarted","Data":"b6789627c40d61fc3ca5f4b13b0af850347f7d3f9d0c9870dbb1545e011da445"} Jun 09 21:53:18.318818 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.318786 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b0681c1-736d-4060-a145-3010b4f553b7-tls-certs\") pod \"model-serving-api-5dd488fc48-299rn\" (UID: \"6b0681c1-736d-4060-a145-3010b4f553b7\") " pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:18.318938 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.318828 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pk8w\" (UniqueName: \"kubernetes.io/projected/6b0681c1-736d-4060-a145-3010b4f553b7-kube-api-access-5pk8w\") pod \"model-serving-api-5dd488fc48-299rn\" (UID: \"6b0681c1-736d-4060-a145-3010b4f553b7\") " pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:18.319016 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:53:18.318951 2560 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 21:53:18.319070 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:53:18.319026 2560 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b0681c1-736d-4060-a145-3010b4f553b7-tls-certs podName:6b0681c1-736d-4060-a145-3010b4f553b7 nodeName:}" failed. No retries permitted until 2026-06-09 21:53:18.819005095 +0000 UTC m=+469.683264576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6b0681c1-736d-4060-a145-3010b4f553b7-tls-certs") pod "model-serving-api-5dd488fc48-299rn" (UID: "6b0681c1-736d-4060-a145-3010b4f553b7") : secret "model-serving-api-tls" not found Jun 09 21:53:18.326940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.326919 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pk8w\" (UniqueName: \"kubernetes.io/projected/6b0681c1-736d-4060-a145-3010b4f553b7-kube-api-access-5pk8w\") pod \"model-serving-api-5dd488fc48-299rn\" (UID: \"6b0681c1-736d-4060-a145-3010b4f553b7\") " pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:18.439484 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.439406 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:18.461658 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.461631 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:18.610238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.610164 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-798gj"] Jun 09 21:53:18.615668 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:18.615632 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5c3da3_dfb2_453c_b275_22f9f590c1bd.slice/crio-37641374639e7cbc51a96784e729877f9d8ca1a80ca0d80599feb95fc69c9437 WatchSource:0}: Error finding container 37641374639e7cbc51a96784e729877f9d8ca1a80ca0d80599feb95fc69c9437: Status 404 returned error can't find the container with id 37641374639e7cbc51a96784e729877f9d8ca1a80ca0d80599feb95fc69c9437 Jun 09 21:53:18.823165 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.823067 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b0681c1-736d-4060-a145-3010b4f553b7-tls-certs\") pod \"model-serving-api-5dd488fc48-299rn\" (UID: \"6b0681c1-736d-4060-a145-3010b4f553b7\") " pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:18.826442 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:18.826414 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6b0681c1-736d-4060-a145-3010b4f553b7-tls-certs\") pod \"model-serving-api-5dd488fc48-299rn\" (UID: \"6b0681c1-736d-4060-a145-3010b4f553b7\") " pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:19.041498 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:19.041463 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:19.207947 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:19.207873 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-299rn"] Jun 09 21:53:19.212766 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:19.212738 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0681c1_736d_4060_a145_3010b4f553b7.slice/crio-e30b11ff0294fdea4cb023dd8e2d427a6422cbf6bd652beba64e34d3c10e6925 WatchSource:0}: Error finding container e30b11ff0294fdea4cb023dd8e2d427a6422cbf6bd652beba64e34d3c10e6925: Status 404 returned error can't find the container with id e30b11ff0294fdea4cb023dd8e2d427a6422cbf6bd652beba64e34d3c10e6925 Jun 09 21:53:19.246623 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:19.246584 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-798gj" event={"ID":"fc5c3da3-dfb2-453c-b275-22f9f590c1bd","Type":"ContainerStarted","Data":"37641374639e7cbc51a96784e729877f9d8ca1a80ca0d80599feb95fc69c9437"} Jun 09 21:53:19.248963 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:19.248929 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-299rn" event={"ID":"6b0681c1-736d-4060-a145-3010b4f553b7","Type":"ContainerStarted","Data":"e30b11ff0294fdea4cb023dd8e2d427a6422cbf6bd652beba64e34d3c10e6925"} Jun 09 21:53:23.268257 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.268212 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-798gj" event={"ID":"fc5c3da3-dfb2-453c-b275-22f9f590c1bd","Type":"ContainerStarted","Data":"cdf78f8bc2d182238f3d0b2ca3a00d9ce0a9cc5c5372d63ea787bba2694363ff"} Jun 09 21:53:23.268716 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.268318 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:23.269687 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.269664 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" event={"ID":"60903d5c-2083-4e9b-bbe1-c77b22461f4a","Type":"ContainerStarted","Data":"519e17fe8b5e7e1673617261997cb82a3f14fb5fabcf2a2ea5dbbb1055112fa4"} Jun 09 21:53:23.271077 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.271052 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-299rn" event={"ID":"6b0681c1-736d-4060-a145-3010b4f553b7","Type":"ContainerStarted","Data":"a9179d800d5cb17941604e022f557df730a7c70b7054035cd7f0d17ae9b196ad"} Jun 09 21:53:23.271196 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.271184 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:23.283741 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.283701 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-798gj" podStartSLOduration=2.673843275 podStartE2EDuration="6.283688383s" totalImagesPullingTime="3.609845108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:23.281811305 +0000 UTC m=+474.146070807" watchObservedRunningTime="2026-06-09 21:53:23.283688383 +0000 UTC m=+474.147947927" Jun 09 21:53:23.297062 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.297025 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d56bf64cc-n4ssl" podStartSLOduration=2.012695148 podStartE2EDuration="6.297013298s" totalImagesPullingTime="4.28431815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:23.295498405 +0000 UTC m=+474.159757931" watchObservedRunningTime="2026-06-09 21:53:23.297013298 +0000 UTC m=+474.161272798" Jun 09 21:53:23.310155 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:23.310112 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-299rn" podStartSLOduration=1.786410265 podStartE2EDuration="5.310097873s" totalImagesPullingTime="3.523687608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:23.309365716 +0000 UTC m=+474.173625217" watchObservedRunningTime="2026-06-09 21:53:23.310097873 +0000 UTC m=+474.174357373" Jun 09 21:53:26.264962 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.264919 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:26.317532 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.317496 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z2rq5"] Jun 09 21:53:26.320801 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.320779 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.323292 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.323273 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 21:53:26.323292 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.323290 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-66jf8\"" Jun 09 21:53:26.329294 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.329273 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp"] Jun 09 21:53:26.332180 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.332164 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.334904 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.334889 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 21:53:26.335068 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.335054 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-g8vlg\"" Jun 09 21:53:26.342543 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.342511 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z2rq5"] Jun 09 21:53:26.351278 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.351247 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp"] Jun 09 21:53:26.358614 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.358569 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:26.492717 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.492682 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92e1e478-6c5e-4caf-b5e5-27e986096d09-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5twrp\" (UID: \"92e1e478-6c5e-4caf-b5e5-27e986096d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.492891 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.492734 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxzx\" (UniqueName: \"kubernetes.io/projected/e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2-kube-api-access-hqxzx\") pod \"kserve-controller-manager-69fc866d76-z2rq5\" (UID: \"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.492891 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.492810 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbsc8\" (UniqueName: \"kubernetes.io/projected/92e1e478-6c5e-4caf-b5e5-27e986096d09-kube-api-access-lbsc8\") pod \"llmisvc-controller-manager-864bfd7bc9-5twrp\" (UID: \"92e1e478-6c5e-4caf-b5e5-27e986096d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.492891 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.492871 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2-cert\") pod \"kserve-controller-manager-69fc866d76-z2rq5\" (UID: \"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.581730 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.581607 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:26.598583 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.593792 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2-cert\") pod \"kserve-controller-manager-69fc866d76-z2rq5\" (UID: \"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.598583 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.593856 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92e1e478-6c5e-4caf-b5e5-27e986096d09-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5twrp\" (UID: \"92e1e478-6c5e-4caf-b5e5-27e986096d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.598583 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.593901 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxzx\" (UniqueName: \"kubernetes.io/projected/e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2-kube-api-access-hqxzx\") pod \"kserve-controller-manager-69fc866d76-z2rq5\" (UID: \"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.598583 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.593946 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbsc8\" (UniqueName: \"kubernetes.io/projected/92e1e478-6c5e-4caf-b5e5-27e986096d09-kube-api-access-lbsc8\") pod \"llmisvc-controller-manager-864bfd7bc9-5twrp\" (UID: \"92e1e478-6c5e-4caf-b5e5-27e986096d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.598583 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.597410 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2-cert\") pod \"kserve-controller-manager-69fc866d76-z2rq5\" (UID: \"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.600135 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.600111 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/92e1e478-6c5e-4caf-b5e5-27e986096d09-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5twrp\" (UID: \"92e1e478-6c5e-4caf-b5e5-27e986096d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.608103 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.608069 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbsc8\" (UniqueName: \"kubernetes.io/projected/92e1e478-6c5e-4caf-b5e5-27e986096d09-kube-api-access-lbsc8\") pod \"llmisvc-controller-manager-864bfd7bc9-5twrp\" (UID: \"92e1e478-6c5e-4caf-b5e5-27e986096d09\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.609082 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.609060 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxzx\" (UniqueName: \"kubernetes.io/projected/e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2-kube-api-access-hqxzx\") pod \"kserve-controller-manager-69fc866d76-z2rq5\" (UID: \"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2\") " pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.630984 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.630948 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:26.641110 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.641091 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:26.786165 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.786142 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-z2rq5"] Jun 09 21:53:26.789551 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:26.789509 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5e3049a_1dd8_4ba0_ac48_2afd2e7b08f2.slice/crio-a12418453581b81baaa84d80227db49ad7fca88426891cfd075a7c3614f71ce8 WatchSource:0}: Error finding container a12418453581b81baaa84d80227db49ad7fca88426891cfd075a7c3614f71ce8: Status 404 returned error can't find the container with id a12418453581b81baaa84d80227db49ad7fca88426891cfd075a7c3614f71ce8 Jun 09 21:53:26.810975 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:26.810948 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp"] Jun 09 21:53:26.813620 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:26.813594 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod92e1e478_6c5e_4caf_b5e5_27e986096d09.slice/crio-b2e7002da24bd25913bf77b6ed51a3ea0c3bb750fe04487388d3d101d52e946c WatchSource:0}: Error finding container b2e7002da24bd25913bf77b6ed51a3ea0c3bb750fe04487388d3d101d52e946c: Status 404 returned error can't find the container with id b2e7002da24bd25913bf77b6ed51a3ea0c3bb750fe04487388d3d101d52e946c Jun 09 21:53:27.290219 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:27.290177 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" event={"ID":"92e1e478-6c5e-4caf-b5e5-27e986096d09","Type":"ContainerStarted","Data":"b2e7002da24bd25913bf77b6ed51a3ea0c3bb750fe04487388d3d101d52e946c"} Jun 09 21:53:27.291598 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:27.291570 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" event={"ID":"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2","Type":"ContainerStarted","Data":"a12418453581b81baaa84d80227db49ad7fca88426891cfd075a7c3614f71ce8"} Jun 09 21:53:27.536662 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:27.536627 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:27.632094 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:27.632060 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:27.866589 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:27.866554 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:27.936386 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:27.936286 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:29.878468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:29.878431 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:29.932491 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:29.932453 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:30.310595 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.310558 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" event={"ID":"92e1e478-6c5e-4caf-b5e5-27e986096d09","Type":"ContainerStarted","Data":"091533b0059ce00d32953b4f0a5c33d4df56df3b9160b758848549b29d1a47f4"} Jun 09 21:53:30.310764 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.310681 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:53:30.312276 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.312249 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" event={"ID":"e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2","Type":"ContainerStarted","Data":"03b1ef37a217319f690f8058054321ea6ace81cf06c540d4936c12148907e7ca"} Jun 09 21:53:30.312408 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.312379 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:53:30.328527 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.328482 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" podStartSLOduration=1.008934103 podStartE2EDuration="4.328467835s" totalImagesPullingTime="3.319533732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:30.327426882 +0000 UTC m=+481.191686384" watchObservedRunningTime="2026-06-09 21:53:30.328467835 +0000 UTC m=+481.192727354" Jun 09 21:53:30.347805 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.347759 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" podStartSLOduration=1.008455403 podStartE2EDuration="4.347744852s" totalImagesPullingTime="3.339289449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:30.347099708 +0000 UTC m=+481.211359216" watchObservedRunningTime="2026-06-09 21:53:30.347744852 +0000 UTC m=+481.212004353" Jun 09 21:53:30.354652 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.354618 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:30.442736 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:30.442661 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:31.506064 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:31.506022 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:31.624893 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:31.624853 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:32.362061 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:32.362024 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:32.455571 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:32.455530 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:32.956512 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:32.956458 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:33.207405 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.207318 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v"] Jun 09 21:53:33.213490 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.213465 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.216223 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.216202 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 21:53:33.216415 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.216401 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-vln92\"" Jun 09 21:53:33.216498 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.216441 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 21:53:33.229441 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.229411 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v"] Jun 09 21:53:33.257962 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.257934 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3f728aca-22f2-4da3-bac0-f3ec0f4197f4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c6p5v\" (UID: \"3f728aca-22f2-4da3-bac0-f3ec0f4197f4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.257962 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.257962 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msqkt\" (UniqueName: \"kubernetes.io/projected/3f728aca-22f2-4da3-bac0-f3ec0f4197f4-kube-api-access-msqkt\") pod \"servicemesh-operator3-57f65f65fb-c6p5v\" (UID: \"3f728aca-22f2-4da3-bac0-f3ec0f4197f4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.358482 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.358447 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3f728aca-22f2-4da3-bac0-f3ec0f4197f4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c6p5v\" (UID: \"3f728aca-22f2-4da3-bac0-f3ec0f4197f4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.358482 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.358482 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msqkt\" (UniqueName: \"kubernetes.io/projected/3f728aca-22f2-4da3-bac0-f3ec0f4197f4-kube-api-access-msqkt\") pod \"servicemesh-operator3-57f65f65fb-c6p5v\" (UID: \"3f728aca-22f2-4da3-bac0-f3ec0f4197f4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.361255 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.361234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/3f728aca-22f2-4da3-bac0-f3ec0f4197f4-operator-config\") pod \"servicemesh-operator3-57f65f65fb-c6p5v\" (UID: \"3f728aca-22f2-4da3-bac0-f3ec0f4197f4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.367308 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.367279 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msqkt\" (UniqueName: \"kubernetes.io/projected/3f728aca-22f2-4da3-bac0-f3ec0f4197f4-kube-api-access-msqkt\") pod \"servicemesh-operator3-57f65f65fb-c6p5v\" (UID: \"3f728aca-22f2-4da3-bac0-f3ec0f4197f4\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.524643 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.524551 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:33.664809 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.664774 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v"] Jun 09 21:53:33.668453 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:33.668426 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f728aca_22f2_4da3_bac0_f3ec0f4197f4.slice/crio-75759bf3189d193f491847b988e1a93fc8bf106406466b591f17327e981c5056 WatchSource:0}: Error finding container 75759bf3189d193f491847b988e1a93fc8bf106406466b591f17327e981c5056: Status 404 returned error can't find the container with id 75759bf3189d193f491847b988e1a93fc8bf106406466b591f17327e981c5056 Jun 09 21:53:33.789280 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.789194 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-54b8db6758-jjdfr"] Jun 09 21:53:33.792541 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.792516 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:33.795213 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.795170 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kqgcq\"" Jun 09 21:53:33.795491 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.795469 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 21:53:33.799289 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.799261 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-54b8db6758-jjdfr"] Jun 09 21:53:33.848444 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.848398 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:33.863217 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.863162 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7309271e-4ae3-436c-947d-ebe2fcffef44-redirect-config\") pod \"dashboard-redirect-54b8db6758-jjdfr\" (UID: \"7309271e-4ae3-436c-947d-ebe2fcffef44\") " pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:33.863375 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.863265 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zck2\" (UniqueName: \"kubernetes.io/projected/7309271e-4ae3-436c-947d-ebe2fcffef44-kube-api-access-7zck2\") pod \"dashboard-redirect-54b8db6758-jjdfr\" (UID: \"7309271e-4ae3-436c-947d-ebe2fcffef44\") " pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:33.964371 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.964323 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7309271e-4ae3-436c-947d-ebe2fcffef44-redirect-config\") pod \"dashboard-redirect-54b8db6758-jjdfr\" (UID: \"7309271e-4ae3-436c-947d-ebe2fcffef44\") " pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:33.964721 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.964392 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zck2\" (UniqueName: \"kubernetes.io/projected/7309271e-4ae3-436c-947d-ebe2fcffef44-kube-api-access-7zck2\") pod \"dashboard-redirect-54b8db6758-jjdfr\" (UID: \"7309271e-4ae3-436c-947d-ebe2fcffef44\") " pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:33.964996 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.964977 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7309271e-4ae3-436c-947d-ebe2fcffef44-redirect-config\") pod \"dashboard-redirect-54b8db6758-jjdfr\" (UID: \"7309271e-4ae3-436c-947d-ebe2fcffef44\") " pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:33.980833 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:33.980808 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zck2\" (UniqueName: \"kubernetes.io/projected/7309271e-4ae3-436c-947d-ebe2fcffef44-kube-api-access-7zck2\") pod \"dashboard-redirect-54b8db6758-jjdfr\" (UID: \"7309271e-4ae3-436c-947d-ebe2fcffef44\") " pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:34.106026 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:34.105979 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" Jun 09 21:53:34.236152 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:34.236128 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-54b8db6758-jjdfr"] Jun 09 21:53:34.238447 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:34.238415 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7309271e_4ae3_436c_947d_ebe2fcffef44.slice/crio-8c13b63ad90b32c8716baae72725ce7fb9429dc22bb96d00bbb7eab131ef2da7 WatchSource:0}: Error finding container 8c13b63ad90b32c8716baae72725ce7fb9429dc22bb96d00bbb7eab131ef2da7: Status 404 returned error can't find the container with id 8c13b63ad90b32c8716baae72725ce7fb9429dc22bb96d00bbb7eab131ef2da7 Jun 09 21:53:34.278327 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:34.278303 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-798gj" Jun 09 21:53:34.280385 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:34.280368 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-299rn" Jun 09 21:53:34.357155 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:34.357020 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" event={"ID":"7309271e-4ae3-436c-947d-ebe2fcffef44","Type":"ContainerStarted","Data":"8c13b63ad90b32c8716baae72725ce7fb9429dc22bb96d00bbb7eab131ef2da7"} Jun 09 21:53:34.359467 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:34.359418 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" event={"ID":"3f728aca-22f2-4da3-bac0-f3ec0f4197f4","Type":"ContainerStarted","Data":"75759bf3189d193f491847b988e1a93fc8bf106406466b591f17327e981c5056"} Jun 09 21:53:37.378426 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:37.378366 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" event={"ID":"7309271e-4ae3-436c-947d-ebe2fcffef44","Type":"ContainerStarted","Data":"9daa11d699d6303b622177b7aabbd9e56368d6da8b6ed5c79d077b09ccb91a57"} Jun 09 21:53:37.380601 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:37.380573 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" event={"ID":"3f728aca-22f2-4da3-bac0-f3ec0f4197f4","Type":"ContainerStarted","Data":"0cdeb40968924780c6179d12c3d7736e3483f602efde977875cb077f813784b9"} Jun 09 21:53:37.380734 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:37.380708 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:53:37.396358 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:37.396278 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-54b8db6758-jjdfr" podStartSLOduration=1.5751238220000001 podStartE2EDuration="4.396260297s" totalImagesPullingTime="2.821136475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:37.394508611 +0000 UTC m=+488.258768110" watchObservedRunningTime="2026-06-09 21:53:37.396260297 +0000 UTC m=+488.260519800" Jun 09 21:53:37.412778 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:37.412727 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" podStartSLOduration=1.077124711 podStartE2EDuration="4.412712674s" totalImagesPullingTime="3.335587963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:37.410872434 +0000 UTC m=+488.275131935" watchObservedRunningTime="2026-06-09 21:53:37.412712674 +0000 UTC m=+488.276972175" Jun 09 21:53:42.794381 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.794323 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:42.828821 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.828788 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6"] Jun 09 21:53:42.832294 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.832277 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:42.835438 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.835407 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 21:53:42.835576 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.835457 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 21:53:42.835850 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.835829 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 21:53:42.836226 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.836213 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 21:53:42.836543 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.836526 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5t5bj\"" Jun 09 21:53:42.852549 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.852516 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6"] Jun 09 21:53:42.891291 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.891260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:42.949840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.949805 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f56866-a405-4fda-918e-047659b82022-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:42.949840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.949842 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6f56866-a405-4fda-918e-047659b82022-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:42.950051 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.949867 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:42.950051 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.949930 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwl9f\" (UniqueName: \"kubernetes.io/projected/e6f56866-a405-4fda-918e-047659b82022-kube-api-access-gwl9f\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:42.950051 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.949962 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f56866-a405-4fda-918e-047659b82022-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:42.950051 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.950008 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:42.950051 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:42.950032 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.050940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.050836 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.050940 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.050896 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.051151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.050927 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f56866-a405-4fda-918e-047659b82022-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.051151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.050977 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6f56866-a405-4fda-918e-047659b82022-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.051151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.051010 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.051151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.051057 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwl9f\" (UniqueName: \"kubernetes.io/projected/e6f56866-a405-4fda-918e-047659b82022-kube-api-access-gwl9f\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.051151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.051109 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f56866-a405-4fda-918e-047659b82022-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.051709 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.051680 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e6f56866-a405-4fda-918e-047659b82022-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.053663 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.053632 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.053957 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.053922 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.053957 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.053947 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e6f56866-a405-4fda-918e-047659b82022-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.054151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.053997 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6f56866-a405-4fda-918e-047659b82022-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.062229 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.062198 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6f56866-a405-4fda-918e-047659b82022-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.062521 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.062497 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwl9f\" (UniqueName: \"kubernetes.io/projected/e6f56866-a405-4fda-918e-047659b82022-kube-api-access-gwl9f\") pod \"istiod-openshift-gateway-75c67f8887-dthf6\" (UID: \"e6f56866-a405-4fda-918e-047659b82022\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.087559 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.087525 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:43.143140 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.143108 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:43.188658 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.188627 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:43.281783 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.281758 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6"] Jun 09 21:53:43.283670 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:53:43.283642 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f56866_a405_4fda_918e_047659b82022.slice/crio-e7c732ac4074e0f26aea8b56256e5148aae288bb1cac062aa09b25142a9d7cfa WatchSource:0}: Error finding container e7c732ac4074e0f26aea8b56256e5148aae288bb1cac062aa09b25142a9d7cfa: Status 404 returned error can't find the container with id e7c732ac4074e0f26aea8b56256e5148aae288bb1cac062aa09b25142a9d7cfa Jun 09 21:53:43.360668 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.360640 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:43.408633 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:43.408587 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" event={"ID":"e6f56866-a405-4fda-918e-047659b82022","Type":"ContainerStarted","Data":"e7c732ac4074e0f26aea8b56256e5148aae288bb1cac062aa09b25142a9d7cfa"} Jun 09 21:53:45.882246 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:45.882205 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:53:45.882663 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:45.882290 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:53:46.429013 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:46.428980 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" event={"ID":"e6f56866-a405-4fda-918e-047659b82022","Type":"ContainerStarted","Data":"c5acbda937aaf04c9eda2b631216d91c0ffb60a2dee901f063f99b939ccdb0dc"} Jun 09 21:53:46.429244 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:46.429226 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:46.430931 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:46.430906 2560 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-dthf6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 21:53:46.431001 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:46.430963 2560 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" podUID="e6f56866-a405-4fda-918e-047659b82022" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 21:53:46.449535 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:46.449477 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" podStartSLOduration=1.853031442 podStartE2EDuration="4.449461517s" totalImagesPullingTime="2.596430075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:53:46.448556536 +0000 UTC m=+497.312816038" watchObservedRunningTime="2026-06-09 21:53:46.449461517 +0000 UTC m=+497.313721018" Jun 09 21:53:46.963404 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:46.963367 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:47.063234 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:47.063197 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:47.257089 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:47.257018 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:47.344731 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:47.344693 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:47.434771 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:47.434735 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-dthf6" Jun 09 21:53:47.529546 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:47.529472 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:47.631256 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:47.631222 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:53:48.387529 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:53:48.387496 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-c6p5v" Jun 09 21:54:01.318640 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:01.318596 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5twrp" Jun 09 21:54:01.321703 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:01.321677 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-z2rq5" Jun 09 21:54:15.243534 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:15.243446 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:18.366377 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:18.366302 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:18.460778 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:18.460744 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:18.557373 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:18.557320 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:46.993173 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:46.993134 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:47.588411 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:47.588373 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:51.893481 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:51.893438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:52.001172 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:52.001141 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:52.107469 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:52.107438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:52.206577 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:52.206495 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:52.632796 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:52.632766 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:52.728644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:52.728614 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:54.237519 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:54.237487 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:54.338512 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:54.338457 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:55.699569 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.699529 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm"] Jun 09 21:54:55.703077 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.703055 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:55.705370 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.705323 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 21:54:55.705486 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.705325 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-h86d7\"" Jun 09 21:54:55.705486 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.705429 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 21:54:55.713022 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.712998 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm"] Jun 09 21:54:55.760028 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.759993 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a806e949-63cc-4c63-959f-98071aede769-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:55.760185 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.760114 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-997fk\" (UniqueName: \"kubernetes.io/projected/a806e949-63cc-4c63-959f-98071aede769-kube-api-access-997fk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:55.860867 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.860831 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-997fk\" (UniqueName: \"kubernetes.io/projected/a806e949-63cc-4c63-959f-98071aede769-kube-api-access-997fk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:55.860867 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.860878 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a806e949-63cc-4c63-959f-98071aede769-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:55.861251 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.861234 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a806e949-63cc-4c63-959f-98071aede769-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:55.868813 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:55.868788 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-997fk\" (UniqueName: \"kubernetes.io/projected/a806e949-63cc-4c63-959f-98071aede769-kube-api-access-997fk\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:56.013411 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:56.013305 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:54:56.165674 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:56.165649 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm"] Jun 09 21:54:56.168403 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:54:56.168375 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda806e949_63cc_4c63_959f_98071aede769.slice/crio-f4d66660ab6cba6b6d8fa71be8326eb4a324bb3b925c3db190a3129623fd32b3 WatchSource:0}: Error finding container f4d66660ab6cba6b6d8fa71be8326eb4a324bb3b925c3db190a3129623fd32b3: Status 404 returned error can't find the container with id f4d66660ab6cba6b6d8fa71be8326eb4a324bb3b925c3db190a3129623fd32b3 Jun 09 21:54:56.748219 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:56.748141 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" event={"ID":"a806e949-63cc-4c63-959f-98071aede769","Type":"ContainerStarted","Data":"f4d66660ab6cba6b6d8fa71be8326eb4a324bb3b925c3db190a3129623fd32b3"} Jun 09 21:54:56.865666 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:56.865635 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:57.026627 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:57.026550 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:54:58.637670 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:54:58.637636 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:00.200692 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:00.200654 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:01.647358 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:01.647309 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:02.600800 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:02.600711 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:02.703858 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:02.703814 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:02.802724 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:02.802682 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:03.594478 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:03.594447 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:03.695797 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:03.695764 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:03.781468 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:03.781437 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" event={"ID":"a806e949-63cc-4c63-959f-98071aede769","Type":"ContainerStarted","Data":"ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993"} Jun 09 21:55:03.781835 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:03.781614 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:03.800027 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:03.799980 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" podStartSLOduration=1.879902894 podStartE2EDuration="8.79996116s" totalImagesPullingTime="6.920058266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:55:03.79738477 +0000 UTC m=+574.661644268" watchObservedRunningTime="2026-06-09 21:55:03.79996116 +0000 UTC m=+574.664220662" Jun 09 21:55:04.003796 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:04.003727 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:04.104303 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:04.104267 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:05.834579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:05.834545 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:06.143871 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:06.143837 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:08.196808 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:08.196776 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:08.253641 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:08.253609 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:12.537864 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:12.537820 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:12.644144 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:12.644114 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:14.788831 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:14.788796 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:15.082457 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:15.082364 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:15.186407 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:15.186376 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:16.110170 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.110136 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n"] Jun 09 21:55:16.113276 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.113258 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.126443 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.126420 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n"] Jun 09 21:55:16.247870 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.247834 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwfw4\" (UniqueName: \"kubernetes.io/projected/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-kube-api-access-kwfw4\") pod \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.248042 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.247917 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.348385 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.348318 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.348545 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.348409 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwfw4\" (UniqueName: \"kubernetes.io/projected/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-kube-api-access-kwfw4\") pod \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.348717 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.348696 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.356898 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.356871 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwfw4\" (UniqueName: \"kubernetes.io/projected/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-kube-api-access-kwfw4\") pod \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.423486 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.423410 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:16.432018 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.431993 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n"] Jun 09 21:55:16.435611 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.435586 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n"] Jun 09 21:55:16.453973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.453943 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc"] Jun 09 21:55:16.458014 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.457992 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.467200 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.467176 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc"] Jun 09 21:55:16.473127 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.473104 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm"] Jun 09 21:55:16.473288 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.473269 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" podUID="a806e949-63cc-4c63-959f-98071aede769" containerName="manager" containerID="cri-o://ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993" gracePeriod=2 Jun 09 21:55:16.482433 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.482164 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm"] Jun 09 21:55:16.492812 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:16.492772 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="a806e949-63cc-4c63-959f-98071aede769" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:16.650963 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.650932 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmr7q\" (UniqueName: \"kubernetes.io/projected/1dec8793-4ad0-4a7f-914f-258db68ebf46-kube-api-access-kmr7q\") pod \"kuadrant-operator-controller-manager-55467d9f7-j45kc\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.651089 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.651029 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dec8793-4ad0-4a7f-914f-258db68ebf46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j45kc\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.713890 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.713868 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:16.715898 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:16.715862 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="a806e949-63cc-4c63-959f-98071aede769" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:16.751687 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.751658 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmr7q\" (UniqueName: \"kubernetes.io/projected/1dec8793-4ad0-4a7f-914f-258db68ebf46-kube-api-access-kmr7q\") pod \"kuadrant-operator-controller-manager-55467d9f7-j45kc\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.751840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.751739 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dec8793-4ad0-4a7f-914f-258db68ebf46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j45kc\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.752142 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.752121 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dec8793-4ad0-4a7f-914f-258db68ebf46-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-j45kc\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.759423 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.759403 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmr7q\" (UniqueName: \"kubernetes.io/projected/1dec8793-4ad0-4a7f-914f-258db68ebf46-kube-api-access-kmr7q\") pod \"kuadrant-operator-controller-manager-55467d9f7-j45kc\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.769291 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.769271 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:16.842157 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.842123 2560 generic.go:356] "Generic (PLEG): container finished" podID="a806e949-63cc-4c63-959f-98071aede769" containerID="ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993" exitCode=0 Jun 09 21:55:16.842301 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.842219 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:16.842301 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.842270 2560 scope.go:117] "RemoveContainer" containerID="ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993" Jun 09 21:55:16.847361 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:16.847310 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="a806e949-63cc-4c63-959f-98071aede769" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:16.852866 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.852840 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-997fk\" (UniqueName: \"kubernetes.io/projected/a806e949-63cc-4c63-959f-98071aede769-kube-api-access-997fk\") pod \"a806e949-63cc-4c63-959f-98071aede769\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " Jun 09 21:55:16.853258 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.852960 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a806e949-63cc-4c63-959f-98071aede769-extensions-socket-volume\") pod \"a806e949-63cc-4c63-959f-98071aede769\" (UID: \"a806e949-63cc-4c63-959f-98071aede769\") " Jun 09 21:55:16.853876 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.853774 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a806e949-63cc-4c63-959f-98071aede769-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a806e949-63cc-4c63-959f-98071aede769" (UID: "a806e949-63cc-4c63-959f-98071aede769"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 21:55:16.854287 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.854260 2560 scope.go:117] "RemoveContainer" containerID="ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993" Jun 09 21:55:16.854719 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:16.854644 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993\": container with ID starting with ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993 not found: ID does not exist" containerID="ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993" Jun 09 21:55:16.854719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.854681 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993"} err="failed to get container status \"ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993\": rpc error: code = NotFound desc = could not find container \"ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993\": container with ID starting with ea9a9f6e967b7b1378f9532a2bfe681df54fb3c66c2777d49831f7d00c29b993 not found: ID does not exist" Jun 09 21:55:16.856455 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.856428 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a806e949-63cc-4c63-959f-98071aede769-kube-api-access-997fk" (OuterVolumeSpecName: "kube-api-access-997fk") pod "a806e949-63cc-4c63-959f-98071aede769" (UID: "a806e949-63cc-4c63-959f-98071aede769"). InnerVolumeSpecName "kube-api-access-997fk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:55:16.909504 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.909459 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc"] Jun 09 21:55:16.911753 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:55:16.911726 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dec8793_4ad0_4a7f_914f_258db68ebf46.slice/crio-bbdc08e4e19cd9f19dfa18a544d6dc2963f41cd346b8e37aa268caf65cb1e9bf WatchSource:0}: Error finding container bbdc08e4e19cd9f19dfa18a544d6dc2963f41cd346b8e37aa268caf65cb1e9bf: Status 404 returned error can't find the container with id bbdc08e4e19cd9f19dfa18a544d6dc2963f41cd346b8e37aa268caf65cb1e9bf Jun 09 21:55:16.953617 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.953566 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-997fk\" (UniqueName: \"kubernetes.io/projected/a806e949-63cc-4c63-959f-98071aede769-kube-api-access-997fk\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:55:16.953617 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.953589 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a806e949-63cc-4c63-959f-98071aede769-extensions-socket-volume\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:55:16.995541 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:16.995515 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:17.106469 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.106436 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:17.152515 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:17.152477 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-9v8bm\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="a806e949-63cc-4c63-959f-98071aede769" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9v8bm" Jun 09 21:55:17.574487 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.574453 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a806e949-63cc-4c63-959f-98071aede769" path="/var/lib/kubelet/pods/a806e949-63cc-4c63-959f-98071aede769/volumes" Jun 09 21:55:17.584514 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.584492 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:17.684058 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.683970 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:17.848960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.848922 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" event={"ID":"1dec8793-4ad0-4a7f-914f-258db68ebf46","Type":"ContainerStarted","Data":"e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332"} Jun 09 21:55:17.849151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.848978 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" event={"ID":"1dec8793-4ad0-4a7f-914f-258db68ebf46","Type":"ContainerStarted","Data":"bbdc08e4e19cd9f19dfa18a544d6dc2963f41cd346b8e37aa268caf65cb1e9bf"} Jun 09 21:55:17.849151 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.849006 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:17.874460 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:17.874416 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" podStartSLOduration=1.874402693 podStartE2EDuration="1.874402693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:55:17.872170394 +0000 UTC m=+588.736429919" watchObservedRunningTime="2026-06-09 21:55:17.874402693 +0000 UTC m=+588.738662194" Jun 09 21:55:18.967245 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:18.967196 2560 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-dpl8n_kuadrant-system_d90b2c9d-65b7-4958-94f8-d5bfb401eb22_0(4a973d0d1180d0b04b588dc1a7d17134bd30483f6098a67f115c599b8aa26e59): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-dpl8n to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jun 09 21:55:18.967540 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:18.967279 2560 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-dpl8n_kuadrant-system_d90b2c9d-65b7-4958-94f8-d5bfb401eb22_0(4a973d0d1180d0b04b588dc1a7d17134bd30483f6098a67f115c599b8aa26e59): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-dpl8n to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:19.858840 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.858803 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:19.860872 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:19.860843 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="d90b2c9d-65b7-4958-94f8-d5bfb401eb22" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:19.866894 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.866872 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:19.869082 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:19.869056 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="d90b2c9d-65b7-4958-94f8-d5bfb401eb22" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:19.878382 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.878363 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-extensions-socket-volume\") pod \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " Jun 09 21:55:19.878472 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.878458 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwfw4\" (UniqueName: \"kubernetes.io/projected/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-kube-api-access-kwfw4\") pod \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\" (UID: \"d90b2c9d-65b7-4958-94f8-d5bfb401eb22\") " Jun 09 21:55:19.878630 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.878611 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d90b2c9d-65b7-4958-94f8-d5bfb401eb22" (UID: "d90b2c9d-65b7-4958-94f8-d5bfb401eb22"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 21:55:19.878724 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.878711 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-extensions-socket-volume\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:55:19.880633 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.880606 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-kube-api-access-kwfw4" (OuterVolumeSpecName: "kube-api-access-kwfw4") pod "d90b2c9d-65b7-4958-94f8-d5bfb401eb22" (UID: "d90b2c9d-65b7-4958-94f8-d5bfb401eb22"). InnerVolumeSpecName "kube-api-access-kwfw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:55:19.979209 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:19.979154 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwfw4\" (UniqueName: \"kubernetes.io/projected/d90b2c9d-65b7-4958-94f8-d5bfb401eb22-kube-api-access-kwfw4\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:55:20.863094 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:20.863062 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:20.865310 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:20.865283 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="d90b2c9d-65b7-4958-94f8-d5bfb401eb22" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:20.870574 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:20.870545 2560 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-dpl8n\" is forbidden: User \"system:node:ip-10-0-132-68.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-68.ec2.internal' and this object" podUID="d90b2c9d-65b7-4958-94f8-d5bfb401eb22" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-dpl8n" Jun 09 21:55:21.574704 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:21.574670 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d90b2c9d-65b7-4958-94f8-d5bfb401eb22" path="/var/lib/kubelet/pods/d90b2c9d-65b7-4958-94f8-d5bfb401eb22/volumes" Jun 09 21:55:22.596598 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:22.596549 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:23.068180 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:23.068062 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:23.117970 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:23.117932 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:23.463678 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:23.463641 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:23.563735 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:23.563700 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:27.473013 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:27.472975 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:27.572879 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:27.572836 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:28.857406 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:28.857374 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:29.552163 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:29.552141 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:55:29.552247 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:29.552207 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 21:55:34.891657 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:34.891622 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:35.018630 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:35.018585 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:36.931918 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:36.931880 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:37.024783 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:37.024742 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:40.901448 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:40.901414 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc"] Jun 09 21:55:40.901935 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:40.901627 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" podUID="1dec8793-4ad0-4a7f-914f-258db68ebf46" containerName="manager" containerID="cri-o://e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332" gracePeriod=10 Jun 09 21:55:40.950097 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:40.950059 2560 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dec8793_4ad0_4a7f_914f_258db68ebf46.slice/crio-conmon-e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332.scope\": RecentStats: unable to find data in memory cache]" Jun 09 21:55:41.153049 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.152993 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:41.245935 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.245897 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmr7q\" (UniqueName: \"kubernetes.io/projected/1dec8793-4ad0-4a7f-914f-258db68ebf46-kube-api-access-kmr7q\") pod \"1dec8793-4ad0-4a7f-914f-258db68ebf46\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " Jun 09 21:55:41.246127 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.245995 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dec8793-4ad0-4a7f-914f-258db68ebf46-extensions-socket-volume\") pod \"1dec8793-4ad0-4a7f-914f-258db68ebf46\" (UID: \"1dec8793-4ad0-4a7f-914f-258db68ebf46\") " Jun 09 21:55:41.246380 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.246328 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dec8793-4ad0-4a7f-914f-258db68ebf46-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1dec8793-4ad0-4a7f-914f-258db68ebf46" (UID: "1dec8793-4ad0-4a7f-914f-258db68ebf46"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 21:55:41.248085 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.248066 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dec8793-4ad0-4a7f-914f-258db68ebf46-kube-api-access-kmr7q" (OuterVolumeSpecName: "kube-api-access-kmr7q") pod "1dec8793-4ad0-4a7f-914f-258db68ebf46" (UID: "1dec8793-4ad0-4a7f-914f-258db68ebf46"). InnerVolumeSpecName "kube-api-access-kmr7q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:55:41.347206 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.347171 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmr7q\" (UniqueName: \"kubernetes.io/projected/1dec8793-4ad0-4a7f-914f-258db68ebf46-kube-api-access-kmr7q\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:55:41.347206 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.347202 2560 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dec8793-4ad0-4a7f-914f-258db68ebf46-extensions-socket-volume\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:55:41.962994 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.962961 2560 generic.go:356] "Generic (PLEG): container finished" podID="1dec8793-4ad0-4a7f-914f-258db68ebf46" containerID="e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332" exitCode=0 Jun 09 21:55:41.963526 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.963005 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" Jun 09 21:55:41.963526 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.963017 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" event={"ID":"1dec8793-4ad0-4a7f-914f-258db68ebf46","Type":"ContainerDied","Data":"e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332"} Jun 09 21:55:41.963526 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.963074 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc" event={"ID":"1dec8793-4ad0-4a7f-914f-258db68ebf46","Type":"ContainerDied","Data":"bbdc08e4e19cd9f19dfa18a544d6dc2963f41cd346b8e37aa268caf65cb1e9bf"} Jun 09 21:55:41.963526 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.963105 2560 scope.go:117] "RemoveContainer" containerID="e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332" Jun 09 21:55:41.971942 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.971922 2560 scope.go:117] "RemoveContainer" containerID="e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332" Jun 09 21:55:41.972216 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:55:41.972195 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332\": container with ID starting with e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332 not found: ID does not exist" containerID="e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332" Jun 09 21:55:41.972278 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.972229 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332"} err="failed to get container status \"e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332\": rpc error: code = NotFound desc = could not find container \"e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332\": container with ID starting with e5e55978e53cfb08690668df942dfdd0146a4cf2fbf890dc860739372a885332 not found: ID does not exist" Jun 09 21:55:41.982509 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.982481 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc"] Jun 09 21:55:41.986042 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:41.986020 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-j45kc"] Jun 09 21:55:43.441079 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:43.441046 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:43.573972 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:43.573937 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dec8793-4ad0-4a7f-914f-258db68ebf46" path="/var/lib/kubelet/pods/1dec8793-4ad0-4a7f-914f-258db68ebf46/volumes" Jun 09 21:55:45.117719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.117687 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp"] Jun 09 21:55:45.118782 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.118750 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a806e949-63cc-4c63-959f-98071aede769" containerName="manager" Jun 09 21:55:45.118782 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.118782 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="a806e949-63cc-4c63-959f-98071aede769" containerName="manager" Jun 09 21:55:45.118998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.118823 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dec8793-4ad0-4a7f-914f-258db68ebf46" containerName="manager" Jun 09 21:55:45.118998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.118831 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dec8793-4ad0-4a7f-914f-258db68ebf46" containerName="manager" Jun 09 21:55:45.118998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.118924 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="a806e949-63cc-4c63-959f-98071aede769" containerName="manager" Jun 09 21:55:45.118998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.118936 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dec8793-4ad0-4a7f-914f-258db68ebf46" containerName="manager" Jun 09 21:55:45.121133 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.121111 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.123564 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.123543 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-sjz4t\"" Jun 09 21:55:45.132537 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.132512 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp"] Jun 09 21:55:45.153298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.153273 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:45.181396 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181364 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181539 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181411 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181539 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181498 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181539 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181523 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npw6s\" (UniqueName: \"kubernetes.io/projected/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-kube-api-access-npw6s\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181667 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181568 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181667 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181622 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181667 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181649 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181769 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181682 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.181769 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.181720 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.252911 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.252880 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:45.282926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.282885 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.282926 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.282932 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.282949 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.282972 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.282995 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283025 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283044 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283167 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283154 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283492 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283181 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npw6s\" (UniqueName: \"kubernetes.io/projected/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-kube-api-access-npw6s\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283492 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283357 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283492 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283418 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283614 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283496 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283614 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283587 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.283898 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.283850 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.285549 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.285528 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.286085 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.286063 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.290623 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.290599 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.290710 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.290663 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npw6s\" (UniqueName: \"kubernetes.io/projected/a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20-kube-api-access-npw6s\") pod \"maas-default-gateway-openshift-default-8559cd5744-k6vzp\" (UID: \"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.435232 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.435147 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:55:45.578831 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.578803 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp"] Jun 09 21:55:45.580723 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:55:45.580700 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cbfb8e_5fe9_4d13_ae9f_d5f22fd91d20.slice/crio-e9a28611944c31c59be58b555e5005e490b0af617e149ceb34701784c56b07b5 WatchSource:0}: Error finding container e9a28611944c31c59be58b555e5005e490b0af617e149ceb34701784c56b07b5: Status 404 returned error can't find the container with id e9a28611944c31c59be58b555e5005e490b0af617e149ceb34701784c56b07b5 Jun 09 21:55:45.983271 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:45.983236 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" event={"ID":"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20","Type":"ContainerStarted","Data":"e9a28611944c31c59be58b555e5005e490b0af617e149ceb34701784c56b07b5"} Jun 09 21:55:48.848278 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:48.848245 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:55:56.267209 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:55:56.267173 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:01.493963 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:01.493909 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:56:01.494238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:01.494000 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:56:01.494238 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:01.494048 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:56:02.063687 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.063651 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" event={"ID":"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20","Type":"ContainerStarted","Data":"4c08f156e9be0ffefe82ee982c8a3bf1d23ebb55f4dcd8438aaca29d1b40086d"} Jun 09 21:56:02.084315 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.084257 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" podStartSLOduration=1.173327547 podStartE2EDuration="17.084241882s" totalImagesPullingTime="15.910914335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:56:02.081970726 +0000 UTC m=+632.946230221" watchObservedRunningTime="2026-06-09 21:56:02.084241882 +0000 UTC m=+632.948501383" Jun 09 21:56:02.435405 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.435366 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:56:02.440188 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.440162 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:56:02.604579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.604544 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vwcxd"] Jun 09 21:56:02.606720 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.606703 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:02.608906 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.608876 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 21:56:02.609031 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.608959 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sc5rl\"" Jun 09 21:56:02.609031 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.608972 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 21:56:02.609031 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.608962 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 21:56:02.609904 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.609879 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:02.614497 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.614442 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vwcxd"] Jun 09 21:56:02.694489 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.694405 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vwcxd"] Jun 09 21:56:02.706371 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.706318 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:02.746580 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.746545 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtx78\" (UniqueName: \"kubernetes.io/projected/d51d906f-5b86-4e69-87dc-84a8c3c807f4-kube-api-access-gtx78\") pod \"limitador-limitador-64c94fd64f-vwcxd\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:02.746739 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.746638 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d51d906f-5b86-4e69-87dc-84a8c3c807f4-config-file\") pod \"limitador-limitador-64c94fd64f-vwcxd\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:02.759960 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.759934 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:02.847382 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.847322 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d51d906f-5b86-4e69-87dc-84a8c3c807f4-config-file\") pod \"limitador-limitador-64c94fd64f-vwcxd\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:02.847571 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.847419 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtx78\" (UniqueName: \"kubernetes.io/projected/d51d906f-5b86-4e69-87dc-84a8c3c807f4-kube-api-access-gtx78\") pod \"limitador-limitador-64c94fd64f-vwcxd\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:02.848015 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.847991 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d51d906f-5b86-4e69-87dc-84a8c3c807f4-config-file\") pod \"limitador-limitador-64c94fd64f-vwcxd\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:02.854966 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.854939 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtx78\" (UniqueName: \"kubernetes.io/projected/d51d906f-5b86-4e69-87dc-84a8c3c807f4-kube-api-access-gtx78\") pod \"limitador-limitador-64c94fd64f-vwcxd\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:02.918973 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:02.918938 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:03.051074 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:03.051044 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vwcxd"] Jun 09 21:56:03.053419 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:56:03.053392 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51d906f_5b86_4e69_87dc_84a8c3c807f4.slice/crio-48512adf8739eb617a43e7eaefac6336d8f965cce56e882ddf1f8f68c0b58916 WatchSource:0}: Error finding container 48512adf8739eb617a43e7eaefac6336d8f965cce56e882ddf1f8f68c0b58916: Status 404 returned error can't find the container with id 48512adf8739eb617a43e7eaefac6336d8f965cce56e882ddf1f8f68c0b58916 Jun 09 21:56:03.069638 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:03.069614 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" event={"ID":"d51d906f-5b86-4e69-87dc-84a8c3c807f4","Type":"ContainerStarted","Data":"48512adf8739eb617a43e7eaefac6336d8f965cce56e882ddf1f8f68c0b58916"} Jun 09 21:56:03.069821 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:03.069804 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:56:03.070851 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:03.070834 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:56:03.444977 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:03.444937 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:03.498884 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:03.498829 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:06.088201 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:06.088161 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" event={"ID":"d51d906f-5b86-4e69-87dc-84a8c3c807f4","Type":"ContainerStarted","Data":"e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193"} Jun 09 21:56:06.088705 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:06.088226 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:06.103577 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:06.103524 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" podStartSLOduration=1.292792204 podStartE2EDuration="4.103505423s" totalImagesPullingTime="2.810713219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:56:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:56:06.101953137 +0000 UTC m=+636.966212639" watchObservedRunningTime="2026-06-09 21:56:06.103505423 +0000 UTC m=+636.967764924" Jun 09 21:56:17.094446 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:17.094416 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:17.902005 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:17.901971 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vwcxd"] Jun 09 21:56:17.902181 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:17.902141 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" podUID="d51d906f-5b86-4e69-87dc-84a8c3c807f4" containerName="limitador" containerID="cri-o://e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193" gracePeriod=30 Jun 09 21:56:18.450170 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:18.450147 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:18.476544 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:18.476473 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtx78\" (UniqueName: \"kubernetes.io/projected/d51d906f-5b86-4e69-87dc-84a8c3c807f4-kube-api-access-gtx78\") pod \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " Jun 09 21:56:18.476544 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:18.476539 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d51d906f-5b86-4e69-87dc-84a8c3c807f4-config-file\") pod \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\" (UID: \"d51d906f-5b86-4e69-87dc-84a8c3c807f4\") " Jun 09 21:56:18.476918 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:18.476888 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51d906f-5b86-4e69-87dc-84a8c3c807f4-config-file" (OuterVolumeSpecName: "config-file") pod "d51d906f-5b86-4e69-87dc-84a8c3c807f4" (UID: "d51d906f-5b86-4e69-87dc-84a8c3c807f4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 21:56:18.478631 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:18.478607 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51d906f-5b86-4e69-87dc-84a8c3c807f4-kube-api-access-gtx78" (OuterVolumeSpecName: "kube-api-access-gtx78") pod "d51d906f-5b86-4e69-87dc-84a8c3c807f4" (UID: "d51d906f-5b86-4e69-87dc-84a8c3c807f4"). InnerVolumeSpecName "kube-api-access-gtx78". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 21:56:18.577740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:18.577678 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtx78\" (UniqueName: \"kubernetes.io/projected/d51d906f-5b86-4e69-87dc-84a8c3c807f4-kube-api-access-gtx78\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:56:18.577740 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:18.577715 2560 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d51d906f-5b86-4e69-87dc-84a8c3c807f4-config-file\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 21:56:19.151409 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.151365 2560 generic.go:356] "Generic (PLEG): container finished" podID="d51d906f-5b86-4e69-87dc-84a8c3c807f4" containerID="e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193" exitCode=0 Jun 09 21:56:19.151409 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.151398 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" Jun 09 21:56:19.151820 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.151434 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" event={"ID":"d51d906f-5b86-4e69-87dc-84a8c3c807f4","Type":"ContainerDied","Data":"e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193"} Jun 09 21:56:19.151820 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.151493 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vwcxd" event={"ID":"d51d906f-5b86-4e69-87dc-84a8c3c807f4","Type":"ContainerDied","Data":"48512adf8739eb617a43e7eaefac6336d8f965cce56e882ddf1f8f68c0b58916"} Jun 09 21:56:19.151820 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.151523 2560 scope.go:117] "RemoveContainer" containerID="e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193" Jun 09 21:56:19.160294 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.160274 2560 scope.go:117] "RemoveContainer" containerID="e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193" Jun 09 21:56:19.160601 ip-10-0-132-68 kubenswrapper[2560]: E0609 21:56:19.160582 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193\": container with ID starting with e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193 not found: ID does not exist" containerID="e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193" Jun 09 21:56:19.160664 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.160610 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193"} err="failed to get container status \"e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193\": rpc error: code = NotFound desc = could not find container \"e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193\": container with ID starting with e9df5bdcaf9840afc0b092662b58bbaf6a57eb61728a3b5f046aa04079bc9193 not found: ID does not exist" Jun 09 21:56:19.172442 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.172404 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vwcxd"] Jun 09 21:56:19.173927 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.173908 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vwcxd"] Jun 09 21:56:19.574106 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:19.574028 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51d906f-5b86-4e69-87dc-84a8c3c807f4" path="/var/lib/kubelet/pods/d51d906f-5b86-4e69-87dc-84a8c3c807f4/volumes" Jun 09 21:56:23.662212 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.662176 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-vbtdb"] Jun 09 21:56:23.662721 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.662701 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51d906f-5b86-4e69-87dc-84a8c3c807f4" containerName="limitador" Jun 09 21:56:23.662774 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.662726 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51d906f-5b86-4e69-87dc-84a8c3c807f4" containerName="limitador" Jun 09 21:56:23.662826 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.662811 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51d906f-5b86-4e69-87dc-84a8c3c807f4" containerName="limitador" Jun 09 21:56:23.667171 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.667147 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:23.669423 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.669401 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 21:56:23.672357 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.672316 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vbtdb"] Jun 09 21:56:23.698975 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.698942 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:23.716174 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.716145 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8h8x\" (UniqueName: \"kubernetes.io/projected/75ba9340-60dc-4325-81a3-e025ada2692f-kube-api-access-n8h8x\") pod \"postgres-69fb4594cf-vbtdb\" (UID: \"75ba9340-60dc-4325-81a3-e025ada2692f\") " pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:23.716305 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.716194 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75ba9340-60dc-4325-81a3-e025ada2692f-data\") pod \"postgres-69fb4594cf-vbtdb\" (UID: \"75ba9340-60dc-4325-81a3-e025ada2692f\") " pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:23.816644 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.816608 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8h8x\" (UniqueName: \"kubernetes.io/projected/75ba9340-60dc-4325-81a3-e025ada2692f-kube-api-access-n8h8x\") pod \"postgres-69fb4594cf-vbtdb\" (UID: \"75ba9340-60dc-4325-81a3-e025ada2692f\") " pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:23.816814 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.816668 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75ba9340-60dc-4325-81a3-e025ada2692f-data\") pod \"postgres-69fb4594cf-vbtdb\" (UID: \"75ba9340-60dc-4325-81a3-e025ada2692f\") " pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:23.816993 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.816978 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/75ba9340-60dc-4325-81a3-e025ada2692f-data\") pod \"postgres-69fb4594cf-vbtdb\" (UID: \"75ba9340-60dc-4325-81a3-e025ada2692f\") " pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:23.824298 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.824264 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8h8x\" (UniqueName: \"kubernetes.io/projected/75ba9340-60dc-4325-81a3-e025ada2692f-kube-api-access-n8h8x\") pod \"postgres-69fb4594cf-vbtdb\" (UID: \"75ba9340-60dc-4325-81a3-e025ada2692f\") " pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:23.979586 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:23.979502 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:24.107579 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:24.107554 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-vbtdb"] Jun 09 21:56:24.109608 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:56:24.109583 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ba9340_60dc_4325_81a3_e025ada2692f.slice/crio-73a682e1829029a09956aaed572b453479aafaaa439384a9d9a2d845881ba15f WatchSource:0}: Error finding container 73a682e1829029a09956aaed572b453479aafaaa439384a9d9a2d845881ba15f: Status 404 returned error can't find the container with id 73a682e1829029a09956aaed572b453479aafaaa439384a9d9a2d845881ba15f Jun 09 21:56:24.175994 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:24.175965 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vbtdb" event={"ID":"75ba9340-60dc-4325-81a3-e025ada2692f","Type":"ContainerStarted","Data":"73a682e1829029a09956aaed572b453479aafaaa439384a9d9a2d845881ba15f"} Jun 09 21:56:29.206024 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:29.205984 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-vbtdb" event={"ID":"75ba9340-60dc-4325-81a3-e025ada2692f","Type":"ContainerStarted","Data":"18d7e8eb6104e56495fd13da86e3e96d811cecaae437f624acec49c2f5146071"} Jun 09 21:56:29.206437 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:29.206095 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:29.220852 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:29.220799 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-vbtdb" podStartSLOduration=1.350832639 podStartE2EDuration="6.220781319s" totalImagesPullingTime="4.86994868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:56:29.219225348 +0000 UTC m=+660.083484862" watchObservedRunningTime="2026-06-09 21:56:29.220781319 +0000 UTC m=+660.085040819" Jun 09 21:56:29.555745 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:29.555715 2560 scope.go:117] "RemoveContainer" containerID="0988414a66055f4ffd394f1675ec1dbf96da39f89a872ce3b983f9f29c5d854c" Jun 09 21:56:35.239683 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:35.239656 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-vbtdb" Jun 09 21:56:35.541855 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:35.541768 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:35.644514 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:35.644477 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:35.772012 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:35.771982 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:43.902292 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:43.902248 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-h7svw"] Jun 09 21:56:43.904624 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:43.904604 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" Jun 09 21:56:43.906896 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:43.906876 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 21:56:43.906982 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:43.906878 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 21:56:43.907736 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:43.907717 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-mndn8\"" Jun 09 21:56:43.912861 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:43.912841 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-h7svw"] Jun 09 21:56:44.003976 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:44.003941 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgmdg\" (UniqueName: \"kubernetes.io/projected/94f72840-b9dd-40b2-b48a-0e674f236d16-kube-api-access-fgmdg\") pod \"keycloak-operator-d67dbbb48-h7svw\" (UID: \"94f72840-b9dd-40b2-b48a-0e674f236d16\") " pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" Jun 09 21:56:44.104998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:44.104958 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgmdg\" (UniqueName: \"kubernetes.io/projected/94f72840-b9dd-40b2-b48a-0e674f236d16-kube-api-access-fgmdg\") pod \"keycloak-operator-d67dbbb48-h7svw\" (UID: \"94f72840-b9dd-40b2-b48a-0e674f236d16\") " pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" Jun 09 21:56:44.113573 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:44.113544 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgmdg\" (UniqueName: \"kubernetes.io/projected/94f72840-b9dd-40b2-b48a-0e674f236d16-kube-api-access-fgmdg\") pod \"keycloak-operator-d67dbbb48-h7svw\" (UID: \"94f72840-b9dd-40b2-b48a-0e674f236d16\") " pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" Jun 09 21:56:44.216654 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:44.216567 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" Jun 09 21:56:44.349916 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:44.349882 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-h7svw"] Jun 09 21:56:44.353370 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:56:44.353322 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f72840_b9dd_40b2_b48a_0e674f236d16.slice/crio-2fff1e9d97b1c6b14a9e8d88aee5196ac8de4848d00871bbc73c169e6e87f34b WatchSource:0}: Error finding container 2fff1e9d97b1c6b14a9e8d88aee5196ac8de4848d00871bbc73c169e6e87f34b: Status 404 returned error can't find the container with id 2fff1e9d97b1c6b14a9e8d88aee5196ac8de4848d00871bbc73c169e6e87f34b Jun 09 21:56:45.279786 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:45.279711 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" event={"ID":"94f72840-b9dd-40b2-b48a-0e674f236d16","Type":"ContainerStarted","Data":"2fff1e9d97b1c6b14a9e8d88aee5196ac8de4848d00871bbc73c169e6e87f34b"} Jun 09 21:56:50.309689 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:50.309640 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" event={"ID":"94f72840-b9dd-40b2-b48a-0e674f236d16","Type":"ContainerStarted","Data":"6805b74fedee5419f44749e37342bff934274a879d1aad66ceb3b5c95935de03"} Jun 09 21:56:50.325598 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:50.325541 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-h7svw" podStartSLOduration=1.855743349 podStartE2EDuration="7.325527847s" totalImagesPullingTime="5.469784498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:56:50.323445729 +0000 UTC m=+681.187705242" watchObservedRunningTime="2026-06-09 21:56:50.325527847 +0000 UTC m=+681.189787347" Jun 09 21:56:58.550854 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:58.550819 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:56:58.648621 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:56:58.648582 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:57:28.988128 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:57:28.988091 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:57:29.085589 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:57:29.085542 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:57:33.939874 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:57:33.939842 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:57:34.038177 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:57:34.038144 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:57:34.109320 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:57:34.109290 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:57:37.290902 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:57:37.290869 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:57:37.388145 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:57:37.388108 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:04.193220 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:04.193164 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:04.294089 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:04.294061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:08.408859 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.408825 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:08.816264 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.816231 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:08.921519 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.921485 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:08.932922 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.932892 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-sgwft"] Jun 09 21:58:08.935396 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.935379 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" Jun 09 21:58:08.937581 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.937560 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4q279\"" Jun 09 21:58:08.937689 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.937623 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 21:58:08.947279 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:08.947251 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-sgwft"] Jun 09 21:58:09.066699 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.066615 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs2kc\" (UniqueName: \"kubernetes.io/projected/ac80415e-5d05-4a90-bf33-3f11b891396c-kube-api-access-cs2kc\") pod \"payload-pre-processing-579785bc64-sgwft\" (UID: \"ac80415e-5d05-4a90-bf33-3f11b891396c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" Jun 09 21:58:09.109253 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.109221 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:09.167530 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.167488 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs2kc\" (UniqueName: \"kubernetes.io/projected/ac80415e-5d05-4a90-bf33-3f11b891396c-kube-api-access-cs2kc\") pod \"payload-pre-processing-579785bc64-sgwft\" (UID: \"ac80415e-5d05-4a90-bf33-3f11b891396c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" Jun 09 21:58:09.175754 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.175731 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs2kc\" (UniqueName: \"kubernetes.io/projected/ac80415e-5d05-4a90-bf33-3f11b891396c-kube-api-access-cs2kc\") pod \"payload-pre-processing-579785bc64-sgwft\" (UID: \"ac80415e-5d05-4a90-bf33-3f11b891396c\") " pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" Jun 09 21:58:09.246368 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.246318 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" Jun 09 21:58:09.374998 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.374963 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-sgwft"] Jun 09 21:58:09.376385 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:58:09.376310 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac80415e_5d05_4a90_bf33_3f11b891396c.slice/crio-521f2e005828d8b99e6fa2b6c56f1be3df234da0c79c9cd4d6b984c54b658d09 WatchSource:0}: Error finding container 521f2e005828d8b99e6fa2b6c56f1be3df234da0c79c9cd4d6b984c54b658d09: Status 404 returned error can't find the container with id 521f2e005828d8b99e6fa2b6c56f1be3df234da0c79c9cd4d6b984c54b658d09 Jun 09 21:58:09.378379 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.378361 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 21:58:09.666405 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:09.666370 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" event={"ID":"ac80415e-5d05-4a90-bf33-3f11b891396c","Type":"ContainerStarted","Data":"521f2e005828d8b99e6fa2b6c56f1be3df234da0c79c9cd4d6b984c54b658d09"} Jun 09 21:58:12.683519 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:12.683478 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" event={"ID":"ac80415e-5d05-4a90-bf33-3f11b891396c","Type":"ContainerStarted","Data":"2f54a1a2e73cf0f917b2fd28abc670429d545710830e3a351e63f1da0b539a14"} Jun 09 21:58:12.683888 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:12.683549 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" Jun 09 21:58:12.700874 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:12.700798 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" podStartSLOduration=2.005506623 podStartE2EDuration="4.700776677s" totalImagesPullingTime="2.695270054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:58:12.698636436 +0000 UTC m=+763.562895938" watchObservedRunningTime="2026-06-09 21:58:12.700776677 +0000 UTC m=+763.565036180" Jun 09 21:58:16.703980 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:16.703895 2560 generic.go:356] "Generic (PLEG): container finished" podID="a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20" containerID="4c08f156e9be0ffefe82ee982c8a3bf1d23ebb55f4dcd8438aaca29d1b40086d" exitCode=0 Jun 09 21:58:16.703980 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:16.703970 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" event={"ID":"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20","Type":"ContainerDied","Data":"4c08f156e9be0ffefe82ee982c8a3bf1d23ebb55f4dcd8438aaca29d1b40086d"} Jun 09 21:58:16.704410 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:16.704385 2560 scope.go:117] "RemoveContainer" containerID="4c08f156e9be0ffefe82ee982c8a3bf1d23ebb55f4dcd8438aaca29d1b40086d" Jun 09 21:58:16.705362 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:16.705319 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:58:16.705416 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:16.705402 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:58:16.705451 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:16.705439 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 21:58:17.713165 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:17.713121 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" event={"ID":"a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20","Type":"ContainerStarted","Data":"f35fce9f55814b4e0e2421c121e414240c0e7a6fd0441177703f829378916b7a"} Jun 09 21:58:18.070360 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:18.070244 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:58:18.435584 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:18.435548 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:58:18.436724 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:18.436696 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-k6vzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jun 09 21:58:18.436837 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:18.436755 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" podUID="a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jun 09 21:58:19.435591 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:19.435555 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-k6vzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jun 09 21:58:19.435979 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:19.435643 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" podUID="a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jun 09 21:58:20.435673 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:20.435638 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-k6vzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jun 09 21:58:20.436158 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:20.435694 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" podUID="a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jun 09 21:58:21.436163 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:21.436121 2560 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-k6vzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body= Jun 09 21:58:21.436585 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:21.436196 2560 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" podUID="a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" Jun 09 21:58:22.440009 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:22.439979 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:58:22.440877 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:22.440858 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-k6vzp" Jun 09 21:58:23.690932 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:23.690902 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-sgwft" Jun 09 21:58:58.423193 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:58.423106 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:58:58.522476 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:58:58.522438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:59:12.360969 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.360927 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm"] Jun 09 21:59:12.364923 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.364899 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.368091 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.368053 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 09 21:59:12.368091 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.368071 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 21:59:12.368091 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.368087 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 21:59:12.368366 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.368166 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2zghg\"" Jun 09 21:59:12.373130 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.373109 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm"] Jun 09 21:59:12.375200 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.375180 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.375315 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.375210 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.375315 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.375230 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.375471 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.375351 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8jln\" (UniqueName: \"kubernetes.io/projected/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-kube-api-access-v8jln\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.375471 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.375409 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.375589 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.375471 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.388828 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.388805 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:59:12.476241 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476205 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8jln\" (UniqueName: \"kubernetes.io/projected/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-kube-api-access-v8jln\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476247 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476294 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476386 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476462 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476719 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476700 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476846 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476825 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.476915 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.476865 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.478727 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.478706 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.479121 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.479101 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.483798 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.483780 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8jln\" (UniqueName: \"kubernetes.io/projected/a7eb9e01-3eca-4cd4-a13f-92296e5cd35e-kube-api-access-v8jln\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm\" (UID: \"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.676581 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.676492 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:12.812155 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.812131 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm"] Jun 09 21:59:12.814517 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:59:12.814489 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7eb9e01_3eca_4cd4_a13f_92296e5cd35e.slice/crio-c9a2520af47ef845525a9aef8a53bf185b1e452e944ed434f149d8f2f51d0f0d WatchSource:0}: Error finding container c9a2520af47ef845525a9aef8a53bf185b1e452e944ed434f149d8f2f51d0f0d: Status 404 returned error can't find the container with id c9a2520af47ef845525a9aef8a53bf185b1e452e944ed434f149d8f2f51d0f0d Jun 09 21:59:12.986792 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:12.986704 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" event={"ID":"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e","Type":"ContainerStarted","Data":"c9a2520af47ef845525a9aef8a53bf185b1e452e944ed434f149d8f2f51d0f0d"} Jun 09 21:59:17.010718 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:17.010679 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" event={"ID":"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e","Type":"ContainerStarted","Data":"5747a01ec25d01e7cbb5847177fb72ba44a534185f7599716bcde72159a469e7"} Jun 09 21:59:17.173397 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:17.173362 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:59:19.020701 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:19.020668 2560 generic.go:356] "Generic (PLEG): container finished" podID="a7eb9e01-3eca-4cd4-a13f-92296e5cd35e" containerID="5747a01ec25d01e7cbb5847177fb72ba44a534185f7599716bcde72159a469e7" exitCode=0 Jun 09 21:59:19.021152 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:19.020747 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" event={"ID":"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e","Type":"ContainerDied","Data":"5747a01ec25d01e7cbb5847177fb72ba44a534185f7599716bcde72159a469e7"} Jun 09 21:59:21.034059 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:21.034025 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" event={"ID":"a7eb9e01-3eca-4cd4-a13f-92296e5cd35e","Type":"ContainerStarted","Data":"a9b5e11b2bbb1921a445faaaf43231fa06498f0f99d9beeec7bd85c1ef177fe3"} Jun 09 21:59:21.050609 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:21.050282 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" podStartSLOduration=2.675666307 podStartE2EDuration="9.050262426s" totalImagesPullingTime="4.894934385s" totalInitContainerRuntime="1.479661734s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:59:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:59:21.050101071 +0000 UTC m=+831.914360572" watchObservedRunningTime="2026-06-09 21:59:21.050262426 +0000 UTC m=+831.914521919" Jun 09 21:59:22.677478 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:22.677435 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:22.677886 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:22.677504 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:22.690071 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:22.690045 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:23.054532 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:23.054452 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm" Jun 09 21:59:33.270549 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:33.270516 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:59:47.162794 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.162752 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7"] Jun 09 21:59:47.167039 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.167019 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.169326 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.169304 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 21:59:47.173771 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.173741 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7"] Jun 09 21:59:47.182700 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.182670 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 21:59:47.294432 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.294390 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.294611 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.294446 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea90e230-2d0c-49ea-9795-374d34ea6888-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.294611 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.294580 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmnk9\" (UniqueName: \"kubernetes.io/projected/ea90e230-2d0c-49ea-9795-374d34ea6888-kube-api-access-bmnk9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.294688 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.294659 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.294726 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.294693 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.294772 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.294726 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.395448 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.395410 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmnk9\" (UniqueName: \"kubernetes.io/projected/ea90e230-2d0c-49ea-9795-374d34ea6888-kube-api-access-bmnk9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.395648 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.395463 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.395648 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.395494 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.395648 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.395520 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.395648 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.395558 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.395648 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.395601 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea90e230-2d0c-49ea-9795-374d34ea6888-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.395915 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.395885 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.396118 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.396091 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.396247 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.396110 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.398109 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.398088 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ea90e230-2d0c-49ea-9795-374d34ea6888-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.398413 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.398396 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ea90e230-2d0c-49ea-9795-374d34ea6888-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.402662 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.402641 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmnk9\" (UniqueName: \"kubernetes.io/projected/ea90e230-2d0c-49ea-9795-374d34ea6888-kube-api-access-bmnk9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7\" (UID: \"ea90e230-2d0c-49ea-9795-374d34ea6888\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.478502 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.478392 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:47.617980 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:47.617953 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7"] Jun 09 21:59:47.620307 ip-10-0-132-68 kubenswrapper[2560]: W0609 21:59:47.620276 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea90e230_2d0c_49ea_9795_374d34ea6888.slice/crio-7b02ed9c5a4f2a13b8777e4f84ade601af30996ab2b33fcd48eec0b2237e3c36 WatchSource:0}: Error finding container 7b02ed9c5a4f2a13b8777e4f84ade601af30996ab2b33fcd48eec0b2237e3c36: Status 404 returned error can't find the container with id 7b02ed9c5a4f2a13b8777e4f84ade601af30996ab2b33fcd48eec0b2237e3c36 Jun 09 21:59:48.162271 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:48.162232 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" event={"ID":"ea90e230-2d0c-49ea-9795-374d34ea6888","Type":"ContainerStarted","Data":"f5ef4968660f45b6e42ea3b262b62aae03285c42fe33f55164960204d7d4e9ba"} Jun 09 21:59:48.162497 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:48.162355 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" event={"ID":"ea90e230-2d0c-49ea-9795-374d34ea6888","Type":"ContainerStarted","Data":"7b02ed9c5a4f2a13b8777e4f84ade601af30996ab2b33fcd48eec0b2237e3c36"} Jun 09 21:59:49.168352 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:49.168298 2560 generic.go:356] "Generic (PLEG): container finished" podID="ea90e230-2d0c-49ea-9795-374d34ea6888" containerID="f5ef4968660f45b6e42ea3b262b62aae03285c42fe33f55164960204d7d4e9ba" exitCode=0 Jun 09 21:59:49.168825 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:49.168364 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" event={"ID":"ea90e230-2d0c-49ea-9795-374d34ea6888","Type":"ContainerDied","Data":"f5ef4968660f45b6e42ea3b262b62aae03285c42fe33f55164960204d7d4e9ba"} Jun 09 21:59:50.176009 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:50.175971 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" event={"ID":"ea90e230-2d0c-49ea-9795-374d34ea6888","Type":"ContainerStarted","Data":"011a551f6274ae73bb13bd49e414a28f48275a8f84ef9cb91602fc83536cef70"} Jun 09 21:59:50.192351 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:50.192277 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" podStartSLOduration=1.699087799 podStartE2EDuration="3.19226276s" totalImagesPullingTime="242.842245ms" totalInitContainerRuntime="1.250332716s" isStatefulPod=false podCreationTimestamp="2026-06-09 21:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 21:59:50.191848201 +0000 UTC m=+861.056107705" watchObservedRunningTime="2026-06-09 21:59:50.19226276 +0000 UTC m=+861.056522261" Jun 09 21:59:57.478908 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:57.478856 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:57.479324 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:57.478941 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:57.491716 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:57.491688 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 21:59:58.229371 ip-10-0-132-68 kubenswrapper[2560]: I0609 21:59:58.226493 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7" Jun 09 22:00:04.985889 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:04.985821 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:00:06.874409 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:06.874360 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:00:06.975559 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:06.975525 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:00:16.847818 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:16.847719 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:00:18.443288 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:18.443249 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:00:25.211282 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:25.211236 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:00:29.580837 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:29.580809 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:00:29.584744 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:00:29.584722 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:01:32.241784 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:01:32.241747 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:01:32.287727 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:01:32.287692 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:01:42.447986 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:01:42.447902 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:01:42.550744 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:01:42.550710 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:01:43.524672 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:01:43.524625 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:01:43.623095 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:01:43.623056 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:03:11.091448 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:03:11.091410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:03:12.908757 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:03:12.908663 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:03:52.669084 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:03:52.669044 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:03:52.766887 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:03:52.766855 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:04:01.150271 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:04:01.150233 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:04:06.807991 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:04:06.807953 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:04:06.949614 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:04:06.949578 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:04:38.897836 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:04:38.897796 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:04:40.129544 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:04:40.129514 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:02.834573 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:02.834489 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:08.451934 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:08.451896 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:08.503443 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:08.503410 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:08.585831 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:08.585795 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:08.685581 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:08.685544 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:08.806681 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:08.806588 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:08.906439 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:08.906411 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:25.256716 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:25.256683 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:25.362243 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:25.362209 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:25.463813 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:25.463782 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:29.608900 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:29.608874 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:05:29.614945 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:29.614924 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:05:31.219771 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:31.219730 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:31.320700 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:31.320665 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:39.357801 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:39.357763 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:39.455118 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:39.455081 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:39.555034 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:39.555003 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:39.654805 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:39.654721 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:56.018831 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:56.018784 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:56.129301 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:56.129260 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:05:56.233451 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:05:56.233414 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:00.964470 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:00.964438 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:01.009728 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:01.009696 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:01.839624 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:01.839594 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:01.893940 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:01.893908 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:22.102390 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:22.102275 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:22.201967 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:22.201938 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:22.372700 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:22.372616 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:27.824833 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:27.824790 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:27.878324 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:27.878288 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:27.944491 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:27.944461 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:28.043789 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:28.043757 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:28.162458 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:28.162425 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:33.737268 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:33.737214 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:06:33.787324 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:06:33.787284 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:08:00.449817 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:08:00.449727 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:08:06.075108 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:08:06.075071 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:10:29.637440 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:10:29.637414 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:10:29.644749 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:10:29.644729 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:11:21.139593 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:11:21.139484 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:14:24.814365 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:14:24.814257 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:14:24.901206 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:14:24.901172 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:15:00.130245 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.130209 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684055-ntd57"] Jun 09 22:15:00.133646 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.133630 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" Jun 09 22:15:00.135869 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.135852 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-2sp5n\"" Jun 09 22:15:00.139927 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.139905 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684055-ntd57"] Jun 09 22:15:00.228835 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.228790 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ml28\" (UniqueName: \"kubernetes.io/projected/ced40f34-5b33-4150-9f7d-013051cae7ca-kube-api-access-6ml28\") pod \"maas-api-key-cleanup-29684055-ntd57\" (UID: \"ced40f34-5b33-4150-9f7d-013051cae7ca\") " pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" Jun 09 22:15:00.329845 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.329807 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ml28\" (UniqueName: \"kubernetes.io/projected/ced40f34-5b33-4150-9f7d-013051cae7ca-kube-api-access-6ml28\") pod \"maas-api-key-cleanup-29684055-ntd57\" (UID: \"ced40f34-5b33-4150-9f7d-013051cae7ca\") " pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" Jun 09 22:15:00.337630 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.337606 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ml28\" (UniqueName: \"kubernetes.io/projected/ced40f34-5b33-4150-9f7d-013051cae7ca-kube-api-access-6ml28\") pod \"maas-api-key-cleanup-29684055-ntd57\" (UID: \"ced40f34-5b33-4150-9f7d-013051cae7ca\") " pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" Jun 09 22:15:00.445806 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.445722 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" Jun 09 22:15:00.581173 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.581147 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684055-ntd57"] Jun 09 22:15:00.583052 ip-10-0-132-68 kubenswrapper[2560]: W0609 22:15:00.583027 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podced40f34_5b33_4150_9f7d_013051cae7ca.slice/crio-e33fc9f8d0954ff6d0403b584e9fb06b660f799b54198ea5c2e429ab9c78649f WatchSource:0}: Error finding container e33fc9f8d0954ff6d0403b584e9fb06b660f799b54198ea5c2e429ab9c78649f: Status 404 returned error can't find the container with id e33fc9f8d0954ff6d0403b584e9fb06b660f799b54198ea5c2e429ab9c78649f Jun 09 22:15:00.585118 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:00.585097 2560 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 22:15:01.586700 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:01.586650 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" event={"ID":"ced40f34-5b33-4150-9f7d-013051cae7ca","Type":"ContainerStarted","Data":"e33fc9f8d0954ff6d0403b584e9fb06b660f799b54198ea5c2e429ab9c78649f"} Jun 09 22:15:03.599481 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:03.599440 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" event={"ID":"ced40f34-5b33-4150-9f7d-013051cae7ca","Type":"ContainerStarted","Data":"6bab06c4bd0cd9590658dda463dcbd0c4167e2e74ba0af6f836ae9a17adec83a"} Jun 09 22:15:03.612881 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:03.612829 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" podStartSLOduration=1.502254558 podStartE2EDuration="3.61281007s" totalImagesPullingTime="2.110555512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 22:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:15:03.612459845 +0000 UTC m=+1774.476719347" watchObservedRunningTime="2026-06-09 22:15:03.61281007 +0000 UTC m=+1774.477069571" Jun 09 22:15:04.605865 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:04.605831 2560 generic.go:356] "Generic (PLEG): container finished" podID="ced40f34-5b33-4150-9f7d-013051cae7ca" containerID="6bab06c4bd0cd9590658dda463dcbd0c4167e2e74ba0af6f836ae9a17adec83a" exitCode=0 Jun 09 22:15:04.606203 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:04.605877 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" event={"ID":"ced40f34-5b33-4150-9f7d-013051cae7ca","Type":"ContainerDied","Data":"6bab06c4bd0cd9590658dda463dcbd0c4167e2e74ba0af6f836ae9a17adec83a"} Jun 09 22:15:05.750630 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:05.750606 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" Jun 09 22:15:05.783541 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:05.783502 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ml28\" (UniqueName: \"kubernetes.io/projected/ced40f34-5b33-4150-9f7d-013051cae7ca-kube-api-access-6ml28\") pod \"ced40f34-5b33-4150-9f7d-013051cae7ca\" (UID: \"ced40f34-5b33-4150-9f7d-013051cae7ca\") " Jun 09 22:15:05.785873 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:05.785839 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ced40f34-5b33-4150-9f7d-013051cae7ca-kube-api-access-6ml28" (OuterVolumeSpecName: "kube-api-access-6ml28") pod "ced40f34-5b33-4150-9f7d-013051cae7ca" (UID: "ced40f34-5b33-4150-9f7d-013051cae7ca"). InnerVolumeSpecName "kube-api-access-6ml28". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 22:15:05.884574 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:05.884494 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ml28\" (UniqueName: \"kubernetes.io/projected/ced40f34-5b33-4150-9f7d-013051cae7ca-kube-api-access-6ml28\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:15:06.617066 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:06.617040 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" Jun 09 22:15:06.617066 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:06.617055 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684055-ntd57" event={"ID":"ced40f34-5b33-4150-9f7d-013051cae7ca","Type":"ContainerDied","Data":"e33fc9f8d0954ff6d0403b584e9fb06b660f799b54198ea5c2e429ab9c78649f"} Jun 09 22:15:06.617272 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:06.617100 2560 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e33fc9f8d0954ff6d0403b584e9fb06b660f799b54198ea5c2e429ab9c78649f" Jun 09 22:15:29.666499 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:29.666379 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:15:29.684288 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:15:29.675655 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:19:14.437059 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:19:14.437015 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:20:29.696533 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:20:29.696409 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:20:29.708540 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:20:29.708520 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:23:21.459144 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:23:21.459061 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:23:26.709885 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:23:26.709848 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:23:50.959732 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:23:50.959693 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:04.027121 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:04.027075 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:05.581442 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.581407 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb"] Jun 09 22:24:05.581979 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.581932 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ced40f34-5b33-4150-9f7d-013051cae7ca" containerName="cleanup" Jun 09 22:24:05.582169 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.581993 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="ced40f34-5b33-4150-9f7d-013051cae7ca" containerName="cleanup" Jun 09 22:24:05.582316 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.582178 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="ced40f34-5b33-4150-9f7d-013051cae7ca" containerName="cleanup" Jun 09 22:24:05.585328 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.585308 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.587570 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.587549 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6dc9c988-openshift-default-dockercfg-9f2kj\"" Jun 09 22:24:05.603949 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.603922 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb"] Jun 09 22:24:05.608090 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.608065 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:05.663422 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.663393 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:05.670630 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670603 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-envoy\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670735 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670646 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-socket\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670735 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670667 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98936e5-f5fa-4267-9054-606da7633b25-istiod-ca-cert\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670735 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670684 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-data\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670735 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670700 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98936e5-f5fa-4267-9054-606da7633b25-istio-podinfo\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670864 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670739 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-credential-socket\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670864 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670771 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-istio-token\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670864 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670845 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4cv\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-kube-api-access-lq4cv\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.670956 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.670870 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-certs\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771447 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771325 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-credential-socket\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771447 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771426 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-istio-token\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771708 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771518 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4cv\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-kube-api-access-lq4cv\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771708 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771551 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-certs\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771708 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771602 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-envoy\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771708 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771628 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-socket\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771708 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771657 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98936e5-f5fa-4267-9054-606da7633b25-istiod-ca-cert\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771708 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771684 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-data\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.771708 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771708 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98936e5-f5fa-4267-9054-606da7633b25-istio-podinfo\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.772061 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771747 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-credential-socket\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.772061 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.771782 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:05.772780 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.772602 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-certs\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.773094 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.772873 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-data\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.773094 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.773057 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98936e5-f5fa-4267-9054-606da7633b25-istiod-ca-cert\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.773289 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.773105 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-socket\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.774470 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.774446 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-envoy\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.774859 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.774836 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98936e5-f5fa-4267-9054-606da7633b25-istio-podinfo\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.780695 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.780670 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-istio-token\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.781096 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.781078 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4cv\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-kube-api-access-lq4cv\") pod \"e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:05.871468 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.871437 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:05.898228 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:05.898192 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:06.044318 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.044296 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb"] Jun 09 22:24:06.046513 ip-10-0-132-68 kubenswrapper[2560]: W0609 22:24:06.046484 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98936e5_f5fa_4267_9054_606da7633b25.slice/crio-28622fcfccced462bacc1fac309a994ded5a11e2c51fb76c55b92f7f3e38dce3 WatchSource:0}: Error finding container 28622fcfccced462bacc1fac309a994ded5a11e2c51fb76c55b92f7f3e38dce3: Status 404 returned error can't find the container with id 28622fcfccced462bacc1fac309a994ded5a11e2c51fb76c55b92f7f3e38dce3 Jun 09 22:24:06.048572 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.048538 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 22:24:06.048682 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.048606 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 22:24:06.048682 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.048635 2560 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 09 22:24:06.215588 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.215488 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" event={"ID":"e98936e5-f5fa-4267-9054-606da7633b25","Type":"ContainerStarted","Data":"b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636"} Jun 09 22:24:06.215588 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.215551 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" event={"ID":"e98936e5-f5fa-4267-9054-606da7633b25","Type":"ContainerStarted","Data":"28622fcfccced462bacc1fac309a994ded5a11e2c51fb76c55b92f7f3e38dce3"} Jun 09 22:24:06.236861 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.236794 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" podStartSLOduration=1.236774177 podStartE2EDuration="1.236774177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 22:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:24:06.232767107 +0000 UTC m=+2317.097026609" watchObservedRunningTime="2026-06-09 22:24:06.236774177 +0000 UTC m=+2317.101033675" Jun 09 22:24:06.898470 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:06.898430 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:07.904202 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:07.904174 2560 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:08.225367 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:08.225247 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:08.226209 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:08.226189 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:09.049310 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:09.049276 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:11.832595 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:11.832517 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:11.933771 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:11.933738 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:11.993942 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:11.993906 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb"] Jun 09 22:24:11.994162 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:11.994134 2560 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" podUID="e98936e5-f5fa-4267-9054-606da7633b25" containerName="istio-proxy" containerID="cri-o://b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636" gracePeriod=30 Jun 09 22:24:12.015642 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:12.015602 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:12.109899 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:12.109860 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:13.616707 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:13.616675 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:17.252924 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.252868 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:17.278627 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.278592 2560 generic.go:356] "Generic (PLEG): container finished" podID="e98936e5-f5fa-4267-9054-606da7633b25" containerID="b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636" exitCode=0 Jun 09 22:24:17.278780 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.278644 2560 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" Jun 09 22:24:17.278780 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.278649 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" event={"ID":"e98936e5-f5fa-4267-9054-606da7633b25","Type":"ContainerDied","Data":"b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636"} Jun 09 22:24:17.278780 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.278761 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb" event={"ID":"e98936e5-f5fa-4267-9054-606da7633b25","Type":"ContainerDied","Data":"28622fcfccced462bacc1fac309a994ded5a11e2c51fb76c55b92f7f3e38dce3"} Jun 09 22:24:17.278955 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.278783 2560 scope.go:117] "RemoveContainer" containerID="b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636" Jun 09 22:24:17.287419 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.287398 2560 scope.go:117] "RemoveContainer" containerID="b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636" Jun 09 22:24:17.287706 ip-10-0-132-68 kubenswrapper[2560]: E0609 22:24:17.287687 2560 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636\": container with ID starting with b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636 not found: ID does not exist" containerID="b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636" Jun 09 22:24:17.287781 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.287715 2560 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636"} err="failed to get container status \"b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636\": rpc error: code = NotFound desc = could not find container \"b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636\": container with ID starting with b71a5a8d5ac53c2e6f3503109530aa5b42c873e7ea96154998afd34abb7a7636 not found: ID does not exist" Jun 09 22:24:17.379789 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.379727 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-data\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.379789 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.379784 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98936e5-f5fa-4267-9054-606da7633b25-istiod-ca-cert\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380033 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.379859 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq4cv\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-kube-api-access-lq4cv\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380033 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.379883 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-istio-token\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380033 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.379918 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-credential-socket\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380033 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.379969 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-socket\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380033 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380016 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98936e5-f5fa-4267-9054-606da7633b25-istio-podinfo\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380271 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380052 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-envoy\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380271 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380098 2560 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-certs\") pod \"e98936e5-f5fa-4267-9054-606da7633b25\" (UID: \"e98936e5-f5fa-4267-9054-606da7633b25\") " Jun 09 22:24:17.380271 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380049 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-data" (OuterVolumeSpecName: "istio-data") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 22:24:17.380271 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380240 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e98936e5-f5fa-4267-9054-606da7633b25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 22:24:17.380271 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380203 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 22:24:17.380271 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380218 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 22:24:17.380598 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380392 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 22:24:17.380598 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380450 2560 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-data\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.380598 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380469 2560 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e98936e5-f5fa-4267-9054-606da7633b25-istiod-ca-cert\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.380598 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380483 2560 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-credential-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.380598 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.380496 2560 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-socket\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.382400 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.382370 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-istio-token" (OuterVolumeSpecName: "istio-token") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 22:24:17.382509 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.382420 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 22:24:17.382509 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.382458 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-kube-api-access-lq4cv" (OuterVolumeSpecName: "kube-api-access-lq4cv") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "kube-api-access-lq4cv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 22:24:17.382509 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.382497 2560 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e98936e5-f5fa-4267-9054-606da7633b25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e98936e5-f5fa-4267-9054-606da7633b25" (UID: "e98936e5-f5fa-4267-9054-606da7633b25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 09 22:24:17.481120 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.481084 2560 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq4cv\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-kube-api-access-lq4cv\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.481120 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.481112 2560 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e98936e5-f5fa-4267-9054-606da7633b25-istio-token\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.481120 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.481122 2560 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e98936e5-f5fa-4267-9054-606da7633b25-istio-podinfo\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.481120 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.481129 2560 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-istio-envoy\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.481411 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.481137 2560 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e98936e5-f5fa-4267-9054-606da7633b25-workload-certs\") on node \"ip-10-0-132-68.ec2.internal\" DevicePath \"\"" Jun 09 22:24:17.597679 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.597649 2560 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb"] Jun 09 22:24:17.600499 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.600472 2560 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6dc9c988-openshift-default-fcd84b58b-sltkb"] Jun 09 22:24:17.686332 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:17.686290 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:18.623265 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:18.623219 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:19.574991 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:19.574955 2560 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e98936e5-f5fa-4267-9054-606da7633b25" path="/var/lib/kubelet/pods/e98936e5-f5fa-4267-9054-606da7633b25/volumes" Jun 09 22:24:21.272742 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:21.272705 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:24.135039 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:24.135006 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:25.276150 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:25.276118 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:25.373367 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:25.373300 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:28.740680 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:28.740646 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:30.887059 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:30.887017 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:30.946305 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:30.946261 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:41.244046 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:41.244015 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-54b8db6758-jjdfr_7309271e-4ae3-436c-947d-ebe2fcffef44/nginx/0.log" Jun 09 22:24:41.467113 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:41.467084 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z2rq5_e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2/manager/0.log" Jun 09 22:24:41.576933 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:41.576851 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5twrp_92e1e478-6c5e-4caf-b5e5-27e986096d09/manager/0.log" Jun 09 22:24:41.906244 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:41.906213 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684055-ntd57_ced40f34-5b33-4150-9f7d-013051cae7ca/cleanup/0.log" Jun 09 22:24:42.130619 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:42.130587 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-299rn_6b0681c1-736d-4060-a145-3010b4f553b7/server/0.log" Jun 09 22:24:42.245395 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:42.245300 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-798gj_fc5c3da3-dfb2-453c-b275-22f9f590c1bd/manager/0.log" Jun 09 22:24:42.480072 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:42.480041 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-mjvxf_40153260-cb04-458e-a064-6e58683943fc/manager/0.log" Jun 09 22:24:42.485507 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:42.485489 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-mjvxf_40153260-cb04-458e-a064-6e58683943fc/copy-manifests/0.log" Jun 09 22:24:42.705310 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:42.705278 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vbtdb_75ba9340-60dc-4325-81a3-e025ada2692f/postgres/0.log" Jun 09 22:24:45.124497 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:45.124466 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dthf6_e6f56866-a405-4fda-918e-047659b82022/discovery/0.log" Jun 09 22:24:45.339743 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:45.339708 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-n4ssl_60903d5c-2083-4e9b-bbe1-c77b22461f4a/kube-auth-proxy/0.log" Jun 09 22:24:45.452208 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:45.452134 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/1.log" Jun 09 22:24:45.560022 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:45.559993 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-sgwft_ac80415e-5d05-4a90-bf33-3f11b891396c/payload-pre-processing/0.log" Jun 09 22:24:46.108080 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:46.108045 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm_a7eb9e01-3eca-4cd4-a13f-92296e5cd35e/storage-initializer/0.log" Jun 09 22:24:46.114294 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:46.114264 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-jkqwm_a7eb9e01-3eca-4cd4-a13f-92296e5cd35e/main/0.log" Jun 09 22:24:46.449530 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:46.449455 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7_ea90e230-2d0c-49ea-9795-374d34ea6888/storage-initializer/0.log" Jun 09 22:24:46.455538 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:46.455516 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cfvzr7_ea90e230-2d0c-49ea-9795-374d34ea6888/main/0.log" Jun 09 22:24:50.486414 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:50.486380 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:50.549530 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:50.549495 2560 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" limit=1024 Jun 09 22:24:53.639351 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:53.639304 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5dcbz_c55a97ee-309d-40d3-a822-ef9bbcf3f94e/global-pull-secret-syncer/0.log" Jun 09 22:24:53.722069 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:53.722034 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9mlsc_4517fb82-81a2-4b3c-b6a6-7b3ab22aac70/konnectivity-agent/0.log" Jun 09 22:24:53.820829 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:53.820796 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-68.ec2.internal_1184e068451611d3df0e645620bcf5d7/haproxy/0.log" Jun 09 22:24:56.878897 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:24:56.878864 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-c6p5v_3f728aca-22f2-4da3-bac0-f3ec0f4197f4/sail-operator/0.log" Jun 09 22:25:00.592558 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.592529 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/alertmanager/0.log" Jun 09 22:25:00.624351 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.624307 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/config-reloader/0.log" Jun 09 22:25:00.646555 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.646531 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/kube-rbac-proxy-web/0.log" Jun 09 22:25:00.667223 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.667199 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/kube-rbac-proxy/0.log" Jun 09 22:25:00.686616 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.686594 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/kube-rbac-proxy-metric/0.log" Jun 09 22:25:00.707183 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.707160 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/prom-label-proxy/0.log" Jun 09 22:25:00.729925 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.729900 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5f3ff4fd-007c-41eb-abe5-3ec20f7bb416/init-config-reloader/0.log" Jun 09 22:25:00.801037 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.801004 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g76s4_10dca87c-3242-47b1-a3d9-dcf5e4305afc/kube-state-metrics/0.log" Jun 09 22:25:00.818656 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.818629 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g76s4_10dca87c-3242-47b1-a3d9-dcf5e4305afc/kube-rbac-proxy-main/0.log" Jun 09 22:25:00.840238 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.840215 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-g76s4_10dca87c-3242-47b1-a3d9-dcf5e4305afc/kube-rbac-proxy-self/0.log" Jun 09 22:25:00.865249 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:00.865182 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-64bf88fc88-mg4wf_2a5be123-7461-4f36-b23f-d4779a9102d6/metrics-server/0.log" Jun 09 22:25:01.086278 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:01.086246 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf6fk_d85c9528-f44e-459b-a4dc-7f8d33887d5b/node-exporter/0.log" Jun 09 22:25:01.108221 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:01.108178 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf6fk_d85c9528-f44e-459b-a4dc-7f8d33887d5b/kube-rbac-proxy/0.log" Jun 09 22:25:01.127471 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:01.127403 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sf6fk_d85c9528-f44e-459b-a4dc-7f8d33887d5b/init-textfile/0.log" Jun 09 22:25:05.962511 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.962480 2560 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n"] Jun 09 22:25:05.962921 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.962835 2560 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e98936e5-f5fa-4267-9054-606da7633b25" containerName="istio-proxy" Jun 09 22:25:05.962921 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.962846 2560 state_mem.go:107] "Deleted CPUSet assignment" podUID="e98936e5-f5fa-4267-9054-606da7633b25" containerName="istio-proxy" Jun 09 22:25:05.962921 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.962920 2560 memory_manager.go:368] "RemoveStaleState removing state" podUID="e98936e5-f5fa-4267-9054-606da7633b25" containerName="istio-proxy" Jun 09 22:25:05.966011 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.965995 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:05.968477 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.968451 2560 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lfcwh\"/\"default-dockercfg-s5h6z\"" Jun 09 22:25:05.968477 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.968471 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcwh\"/\"kube-root-ca.crt\"" Jun 09 22:25:05.969313 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.969296 2560 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcwh\"/\"openshift-service-ca.crt\"" Jun 09 22:25:05.973037 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:05.973013 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n"] Jun 09 22:25:06.107485 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.107447 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g2gs\" (UniqueName: \"kubernetes.io/projected/f22762ec-656d-4714-ac86-8b976968dab8-kube-api-access-6g2gs\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.107485 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.107486 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-proc\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.107712 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.107510 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-podres\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.107712 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.107581 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-sys\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.107712 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.107610 2560 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-lib-modules\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208280 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208244 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-podres\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208460 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208301 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-sys\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208460 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208329 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-lib-modules\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208460 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208384 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g2gs\" (UniqueName: \"kubernetes.io/projected/f22762ec-656d-4714-ac86-8b976968dab8-kube-api-access-6g2gs\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208460 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208411 2560 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-proc\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208460 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208429 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-podres\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208460 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208453 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-sys\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208652 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208486 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-proc\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.208652 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.208497 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f22762ec-656d-4714-ac86-8b976968dab8-lib-modules\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.215818 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.215774 2560 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g2gs\" (UniqueName: \"kubernetes.io/projected/f22762ec-656d-4714-ac86-8b976968dab8-kube-api-access-6g2gs\") pod \"perf-node-gather-daemonset-vtz7n\" (UID: \"f22762ec-656d-4714-ac86-8b976968dab8\") " pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.277511 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.277482 2560 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.409953 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.409924 2560 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n"] Jun 09 22:25:06.412042 ip-10-0-132-68 kubenswrapper[2560]: W0609 22:25:06.412009 2560 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf22762ec_656d_4714_ac86_8b976968dab8.slice/crio-5f4d87030fb153b3b936bf45fc059a37bb9a5f43c7b889f94ee175791242dd70 WatchSource:0}: Error finding container 5f4d87030fb153b3b936bf45fc059a37bb9a5f43c7b889f94ee175791242dd70: Status 404 returned error can't find the container with id 5f4d87030fb153b3b936bf45fc059a37bb9a5f43c7b889f94ee175791242dd70 Jun 09 22:25:06.464611 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.464588 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqkwv_d58b3cb4-2a60-4e55-8507-6b990274c90a/dns/0.log" Jun 09 22:25:06.486965 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.486942 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pqkwv_d58b3cb4-2a60-4e55-8507-6b990274c90a/kube-rbac-proxy/0.log" Jun 09 22:25:06.516145 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.516122 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" event={"ID":"f22762ec-656d-4714-ac86-8b976968dab8","Type":"ContainerStarted","Data":"eed73dcf4c0a1370821497ba4fb72b7b6bbf5c225576d722298da139f2174d1f"} Jun 09 22:25:06.516282 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.516173 2560 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" event={"ID":"f22762ec-656d-4714-ac86-8b976968dab8","Type":"ContainerStarted","Data":"5f4d87030fb153b3b936bf45fc059a37bb9a5f43c7b889f94ee175791242dd70"} Jun 09 22:25:06.516282 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.516203 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:06.531709 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.531670 2560 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" podStartSLOduration=1.531655837 podStartE2EDuration="1.531655837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 22:25:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 22:25:06.530722692 +0000 UTC m=+2377.394982195" watchObservedRunningTime="2026-06-09 22:25:06.531655837 +0000 UTC m=+2377.395915388" Jun 09 22:25:06.555759 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:06.555733 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-64jmm_12f9b2cc-1ce0-44fb-94ee-53043fe84a28/dns-node-resolver/0.log" Jun 09 22:25:07.100872 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:07.100838 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-578796694c-t4dc7_8dcf8fcb-5d35-4997-a76c-2540d0803203/registry/0.log" Jun 09 22:25:07.109387 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:07.109362 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-578796694c-t4dc7_8dcf8fcb-5d35-4997-a76c-2540d0803203/registry/1.log" Jun 09 22:25:07.129384 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:07.129358 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7hdcz_e0390187-24cc-4edb-88ee-be4e2acebaba/node-ca/0.log" Jun 09 22:25:08.160387 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:08.160360 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dthf6_e6f56866-a405-4fda-918e-047659b82022/discovery/0.log" Jun 09 22:25:08.203521 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:08.203495 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-n4ssl_60903d5c-2083-4e9b-bbe1-c77b22461f4a/kube-auth-proxy/0.log" Jun 09 22:25:08.230673 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:08.230645 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/0.log" Jun 09 22:25:08.260832 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:08.260800 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/1.log" Jun 09 22:25:08.304244 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:08.304214 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-sgwft_ac80415e-5d05-4a90-bf33-3f11b891396c/payload-pre-processing/0.log" Jun 09 22:25:08.990791 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:08.990757 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lzqkt_1ed86f98-98e1-4d01-81c3-55d4594957e6/serve-healthcheck-canary/0.log" Jun 09 22:25:09.534505 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:09.534476 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbfhc_88d78bcd-3ac6-483c-8bb5-98c67ac49ae7/kube-rbac-proxy/0.log" Jun 09 22:25:09.553116 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:09.553094 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbfhc_88d78bcd-3ac6-483c-8bb5-98c67ac49ae7/exporter/0.log" Jun 09 22:25:09.572881 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:09.572860 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbfhc_88d78bcd-3ac6-483c-8bb5-98c67ac49ae7/extractor/0.log" Jun 09 22:25:11.935980 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:11.935948 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-54b8db6758-jjdfr_7309271e-4ae3-436c-947d-ebe2fcffef44/nginx/0.log" Jun 09 22:25:11.981400 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:11.981374 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-z2rq5_e5e3049a-1dd8-4ba0-ac48-2afd2e7b08f2/manager/0.log" Jun 09 22:25:12.061290 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.061259 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5twrp_92e1e478-6c5e-4caf-b5e5-27e986096d09/manager/0.log" Jun 09 22:25:12.144424 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.144394 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684055-ntd57_ced40f34-5b33-4150-9f7d-013051cae7ca/cleanup/0.log" Jun 09 22:25:12.233548 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.233470 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-299rn_6b0681c1-736d-4060-a145-3010b4f553b7/server/0.log" Jun 09 22:25:12.278593 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.278567 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-798gj_fc5c3da3-dfb2-453c-b275-22f9f590c1bd/manager/0.log" Jun 09 22:25:12.458989 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.458958 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-mjvxf_40153260-cb04-458e-a064-6e58683943fc/manager/0.log" Jun 09 22:25:12.477256 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.477233 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-96bcfd894-mjvxf_40153260-cb04-458e-a064-6e58683943fc/copy-manifests/0.log" Jun 09 22:25:12.531569 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.531509 2560 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lfcwh/perf-node-gather-daemonset-vtz7n" Jun 09 22:25:12.547915 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:12.547895 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-vbtdb_75ba9340-60dc-4325-81a3-e025ada2692f/postgres/0.log" Jun 09 22:25:18.819243 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:18.819205 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dthf6_e6f56866-a405-4fda-918e-047659b82022/discovery/0.log" Jun 09 22:25:18.848308 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:18.848288 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-n4ssl_60903d5c-2083-4e9b-bbe1-c77b22461f4a/kube-auth-proxy/0.log" Jun 09 22:25:18.865153 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:18.865128 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/0.log" Jun 09 22:25:18.904725 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:18.904695 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/1.log" Jun 09 22:25:18.934866 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:18.934842 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-sgwft_ac80415e-5d05-4a90-bf33-3f11b891396c/payload-pre-processing/0.log" Jun 09 22:25:19.889825 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:19.889794 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-zrjsn_483151ca-20ab-4d36-a8de-852eeeb2ee8b/kube-storage-version-migrator-operator/1.log" Jun 09 22:25:19.890780 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:19.890758 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-zrjsn_483151ca-20ab-4d36-a8de-852eeeb2ee8b/kube-storage-version-migrator-operator/0.log" Jun 09 22:25:20.148154 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:20.148075 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dthf6_e6f56866-a405-4fda-918e-047659b82022/discovery/0.log" Jun 09 22:25:20.172536 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:20.172506 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-n4ssl_60903d5c-2083-4e9b-bbe1-c77b22461f4a/kube-auth-proxy/0.log" Jun 09 22:25:20.192233 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:20.192197 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/0.log" Jun 09 22:25:20.229573 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:20.229543 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/1.log" Jun 09 22:25:20.260737 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:20.260711 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-sgwft_ac80415e-5d05-4a90-bf33-3f11b891396c/payload-pre-processing/0.log" Jun 09 22:25:21.318229 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.318194 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzst2_32968818-8e4b-488a-921f-2216beb2c693/kube-multus-additional-cni-plugins/0.log" Jun 09 22:25:21.337957 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.337934 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzst2_32968818-8e4b-488a-921f-2216beb2c693/egress-router-binary-copy/0.log" Jun 09 22:25:21.356934 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.356908 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzst2_32968818-8e4b-488a-921f-2216beb2c693/cni-plugins/0.log" Jun 09 22:25:21.375985 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.375962 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzst2_32968818-8e4b-488a-921f-2216beb2c693/bond-cni-plugin/0.log" Jun 09 22:25:21.395253 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.395229 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzst2_32968818-8e4b-488a-921f-2216beb2c693/routeoverride-cni/0.log" Jun 09 22:25:21.413582 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.413554 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzst2_32968818-8e4b-488a-921f-2216beb2c693/whereabouts-cni-bincopy/0.log" Jun 09 22:25:21.432402 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.432383 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wzst2_32968818-8e4b-488a-921f-2216beb2c693/whereabouts-cni/0.log" Jun 09 22:25:21.461377 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.461354 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-btmvp_3ba240dd-5ec9-400d-8f30-4dc173075a7d/kube-multus/0.log" Jun 09 22:25:21.588520 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.588495 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f5fx7_b9d90437-5a29-4e28-b396-61a3c8df3d57/network-metrics-daemon/0.log" Jun 09 22:25:21.606557 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.606532 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f5fx7_b9d90437-5a29-4e28-b396-61a3c8df3d57/kube-rbac-proxy/0.log" Jun 09 22:25:21.974281 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.974243 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-dthf6_e6f56866-a405-4fda-918e-047659b82022/discovery/0.log" Jun 09 22:25:21.998137 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:21.998115 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d56bf64cc-n4ssl_60903d5c-2083-4e9b-bbe1-c77b22461f4a/kube-auth-proxy/0.log" Jun 09 22:25:22.014931 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.014900 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/0.log" Jun 09 22:25:22.045063 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.045036 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-k6vzp_a9cbfb8e-5fe9-4d13-ae9f-d5f22fd91d20/istio-proxy/1.log" Jun 09 22:25:22.074594 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.074573 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-sgwft_ac80415e-5d05-4a90-bf33-3f11b891396c/payload-pre-processing/0.log" Jun 09 22:25:22.799717 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.799690 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-controller/0.log" Jun 09 22:25:22.816110 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.816083 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/1.log" Jun 09 22:25:22.816234 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.816165 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovn-acl-logging/0.log" Jun 09 22:25:22.835188 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.835161 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/kube-rbac-proxy-node/0.log" Jun 09 22:25:22.852926 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.852907 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 22:25:22.869589 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.869567 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/northd/0.log" Jun 09 22:25:22.888405 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.888389 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/nbdb/0.log" Jun 09 22:25:22.906910 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.906894 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/sbdb/0.log" Jun 09 22:25:22.948802 ip-10-0-132-68 kubenswrapper[2560]: I0609 22:25:22.948780 2560 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gfwh8_f9ed08f8-145e-4095-b61a-cb7cdef73032/ovnkube-controller/0.log"