Jul 09 15:29:01.156814 ip-10-0-128-112 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 15:29:01.156827 ip-10-0-128-112 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 15:29:01.156838 ip-10-0-128-112 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 15:29:01.157076 ip-10-0-128-112 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 15:29:11.373384 ip-10-0-128-112 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 15:29:11.373405 ip-10-0-128-112 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e51aebac19cd488aa045c873102d4544 -- Jul 09 15:31:10.313812 ip-10-0-128-112 systemd[1]: Starting Kubernetes Kubelet... Jul 09 15:31:10.759788 ip-10-0-128-112 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:31:10.759788 ip-10-0-128-112 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 15:31:10.759788 ip-10-0-128-112 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:31:10.759788 ip-10-0-128-112 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 15:31:10.759788 ip-10-0-128-112 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:31:10.759788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.757977 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763140 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763156 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763159 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763162 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763168 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763172 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763175 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763179 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763182 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763186 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763190 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763194 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763196 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763199 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763202 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763205 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763208 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763212 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763214 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:31:12.105665 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763217 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763219 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763222 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763224 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763227 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763231 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763233 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763237 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763240 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763243 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763245 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763249 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763251 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763254 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763257 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763261 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763264 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763266 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763269 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763272 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:31:12.106513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763274 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763276 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763279 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763281 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763284 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763286 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763289 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763291 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763294 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763297 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763300 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763303 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763305 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763308 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763310 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763313 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763315 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763318 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763321 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:31:12.107333 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763323 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763326 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763328 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763331 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763334 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763336 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763339 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763343 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763346 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763348 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763350 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763353 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763355 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763358 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763360 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763363 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763366 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763368 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763370 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763373 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:31:12.108040 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763375 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763378 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763381 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763384 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763386 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763389 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763392 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763394 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763396 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763399 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763402 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763404 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763407 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763410 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763413 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763416 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763419 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763423 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763427 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763431 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:31:12.108910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.763434 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:31:12.108814 ip-10-0-128-112 systemd[1]: Started Kubernetes Kubelet. Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764242 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764250 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764254 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764257 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764260 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764263 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764267 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764270 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764273 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764276 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764281 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764284 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764287 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764291 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764294 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764298 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764301 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764304 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764307 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:31:12.110039 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764310 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764313 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764316 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764319 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764321 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764324 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764327 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764330 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764332 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764335 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764338 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764340 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764343 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764347 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764350 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764353 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764355 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764358 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764361 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764363 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:31:12.111384 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764366 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764368 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764371 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764374 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764376 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764379 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764381 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764385 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764390 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764394 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764397 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764400 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764402 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764405 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764408 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764411 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764414 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764417 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764419 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764422 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:31:12.112659 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764425 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764428 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764432 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764434 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764437 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764439 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764443 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764446 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764449 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764451 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764454 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764457 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764460 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764462 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764465 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764467 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764470 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764472 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764475 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:31:12.113526 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764477 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764479 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764482 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764501 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764504 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764506 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764509 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764512 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764514 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764517 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764520 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764523 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764525 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764530 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764533 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764535 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764538 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764540 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764543 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764546 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:31:12.114148 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764548 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764946 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764950 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764953 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764956 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764959 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764962 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764964 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764967 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764970 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764973 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764975 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764978 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764980 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764983 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764987 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764990 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764993 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764995 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.764998 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:31:12.115015 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765001 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765003 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765006 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765008 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765011 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765018 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765021 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765024 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765026 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765029 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765032 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765035 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765037 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765040 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765043 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765045 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765048 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765050 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765053 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:31:12.115627 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765055 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765058 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765060 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765063 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765065 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765068 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765070 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765073 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765075 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765078 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765080 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765083 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765086 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765088 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765091 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765093 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765096 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765098 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765104 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765106 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:31:12.116678 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765109 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765111 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765114 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765117 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765119 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765121 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765124 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765126 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765129 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765131 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765134 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765136 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765139 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765142 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765145 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765149 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765153 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765156 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765158 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:31:12.118834 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765161 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765163 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765166 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765169 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765172 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765175 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765178 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765180 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765183 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765187 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765190 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765196 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765199 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765202 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765204 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765207 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765210 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765212 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765215 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765217 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:31:12.119373 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765220 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765223 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765296 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765304 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765310 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765315 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765319 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765322 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765326 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765331 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765334 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765337 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765341 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765344 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765347 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765350 2578 flags.go:64] FLAG: --cgroup-root="" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765356 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765360 2578 flags.go:64] FLAG: --client-ca-file="" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765363 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765365 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765371 2578 flags.go:64] FLAG: --cluster-domain="" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765374 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765376 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 15:31:12.213236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765382 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765385 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765390 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765393 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765396 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765399 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765402 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765405 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765408 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765411 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765414 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765419 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765422 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765425 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765427 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765431 2578 flags.go:64] FLAG: --enable-server="true" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765434 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765438 2578 flags.go:64] FLAG: --event-burst="100" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765441 2578 flags.go:64] FLAG: --event-qps="50" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765444 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765447 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765449 2578 flags.go:64] FLAG: --eviction-hard="" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765453 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765456 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765459 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 15:31:12.214085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765462 2578 flags.go:64] FLAG: --eviction-soft="" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765465 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765468 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765471 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765474 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765477 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765480 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765498 2578 flags.go:64] FLAG: --feature-gates="" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765503 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765506 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765509 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765513 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765516 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765519 2578 flags.go:64] FLAG: --help="false" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765522 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765526 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765529 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765532 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765535 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765539 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765542 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765545 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765548 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 15:31:12.214919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765551 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765554 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765557 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765560 2578 flags.go:64] FLAG: --kube-reserved="" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765563 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765566 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765569 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765571 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765574 2578 flags.go:64] FLAG: --lock-file="" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765577 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765580 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765584 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765589 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765592 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765595 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765598 2578 flags.go:64] FLAG: --logging-format="text" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765603 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765606 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765609 2578 flags.go:64] FLAG: --manifest-url="" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765612 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765617 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765620 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765624 2578 flags.go:64] FLAG: --max-pods="110" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765627 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765630 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 15:31:12.215808 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765633 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765636 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765639 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765642 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765645 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765652 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765655 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765658 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765661 2578 flags.go:64] FLAG: --pod-cidr="" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765664 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765670 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765673 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765676 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765679 2578 flags.go:64] FLAG: --port="10250" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765682 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765684 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0906d423186b31342" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765688 2578 flags.go:64] FLAG: --qos-reserved="" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765691 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765694 2578 flags.go:64] FLAG: --register-node="true" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765697 2578 flags.go:64] FLAG: --register-with-taints="" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765701 2578 flags.go:64] FLAG: --registry-burst="10" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765704 2578 flags.go:64] FLAG: --registry-qps="5" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765707 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765711 2578 flags.go:64] FLAG: --reserved-memory="" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765716 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 15:31:12.216528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765719 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765722 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765725 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765728 2578 flags.go:64] FLAG: --runonce="false" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765731 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765734 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765737 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765740 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765742 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765746 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765749 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765752 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765755 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765758 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765761 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765763 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765766 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765769 2578 flags.go:64] FLAG: --system-cgroups="" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765772 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765777 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765780 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765783 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765788 2578 flags.go:64] FLAG: --tls-min-version="" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765791 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765794 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 15:31:12.217306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765796 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765799 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765803 2578 flags.go:64] FLAG: --v="2" Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765807 2578 flags.go:64] FLAG: --version="false" Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765811 2578 flags.go:64] FLAG: --vmodule="" Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765816 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.765820 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765945 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765949 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765952 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765955 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765958 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765961 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765963 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765966 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765969 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765972 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765975 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765978 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765980 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765983 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:31:12.218024 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765986 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765988 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765991 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765993 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765996 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.765999 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766001 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766003 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766006 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766009 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766011 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766014 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766016 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766019 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766022 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766024 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766029 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766033 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766035 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766039 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:31:12.218828 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766043 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766046 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766048 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766051 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766053 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766056 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766058 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766061 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766063 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766066 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766068 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766071 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766075 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766078 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766081 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766084 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766087 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766090 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766093 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:31:12.219742 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766095 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766098 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766100 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766103 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766106 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766108 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766111 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766113 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766117 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766120 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766124 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766127 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766129 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766132 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766135 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766138 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766142 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766145 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766148 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:31:12.220840 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766151 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766153 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766157 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766159 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766162 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766165 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766167 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766170 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766172 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766175 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766178 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766180 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766183 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766185 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766188 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766190 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766193 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766196 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766198 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766201 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:31:12.221797 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766203 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766206 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766211 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766214 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766218 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766220 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:10.766223 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:10.766233 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.043348 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.043368 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.043953 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.043961 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044046 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044051 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044055 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:31:12.222877 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044059 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044062 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044065 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044070 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044073 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044076 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044079 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044083 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044086 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044089 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044092 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044096 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044100 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044103 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044107 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044110 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044113 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044116 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044118 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044120 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:31:12.223731 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044123 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044126 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044129 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044132 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044134 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044137 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044140 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044142 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044145 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044148 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044150 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044153 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044156 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044159 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044161 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044164 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044167 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044170 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044172 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044175 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:31:12.225003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044178 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044181 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044183 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044186 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044189 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044192 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044194 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044197 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044200 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044202 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044206 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044209 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044212 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044215 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044218 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044220 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044223 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044226 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044228 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:31:12.226062 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044231 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044233 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044236 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044240 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044243 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044246 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044249 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044252 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044255 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044258 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044261 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044263 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044266 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044268 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044271 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044273 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044276 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044279 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044282 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:31:12.226959 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044284 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044287 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044290 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044293 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044295 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044298 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044300 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044303 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044309 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044312 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044314 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044317 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044319 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044322 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044325 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044327 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044330 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:31:12.227520 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044333 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.044338 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044466 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044472 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044475 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044478 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044481 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044484 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044489 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044492 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044494 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044497 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044500 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044503 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:31:12.228142 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044506 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044509 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044513 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044516 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044519 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044522 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044525 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044527 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044530 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044534 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044537 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044540 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044543 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044545 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044548 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044551 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044553 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044556 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044559 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044561 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:31:12.228560 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044564 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044567 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044569 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044571 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044574 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044576 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044580 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044583 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044586 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044588 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044591 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044593 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044596 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044600 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044602 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044605 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044607 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044610 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044612 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044615 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:31:12.229180 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044617 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044621 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044624 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044626 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044629 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044631 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044634 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044636 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044639 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044641 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044644 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044646 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044649 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044651 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044654 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044656 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044659 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044662 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044668 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044670 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:31:12.230113 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044673 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044676 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044678 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044681 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044684 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044704 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044709 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044712 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044714 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044717 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044720 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044722 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044725 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044729 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044731 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044734 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044736 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044739 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044742 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044744 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:31:12.231003 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044746 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044749 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044751 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044754 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044757 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044776 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:12.044781 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.044786 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.044931 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.049122 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.050551 2578 server.go:1019] "Starting client certificate rotation" Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.050660 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.050715 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:31:12.231622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.053311 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:31:12.232121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.057815 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:31:12.232121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.072346 2578 log.go:25] "Validated CRI v1 runtime API" Jul 09 15:31:12.232121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.074502 2578 log.go:25] "Validated CRI v1 image API" Jul 09 15:31:12.232121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.075286 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 15:31:12.232121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.078008 2578 fs.go:135] Filesystem UUIDs: map[176ef339-f5b4-41ff-a5bc-40a03b2bf559:/dev/nvme0n1p4 64a18ffa-03eb-48e8-8ef5-a6cbee93a405:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 09 15:31:12.232121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.078026 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.083508 2578 manager.go:216] Machine: {Timestamp:2026-07-09 15:31:12.08231861 +0000 UTC m=+0.369911299 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106865 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec252a14ac21484690d207ef095a2ab6 SystemUUID:ec252a14-ac21-4846-90d2-07ef095a2ab6 BootID:e51aebac-19cd-488a-a045-c873102d4544 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0a:30:65:ef:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0a:30:65:ef:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:53:4b:3d:70:0e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.083614 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.083747 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.086469 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.086497 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-112.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.087282 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.087297 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.087308 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.088015 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.089361 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092092 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092214 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092254 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092283 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092296 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092317 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 15:31:12.232440 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092333 2578 kubelet.go:398] "Adding apiserver pod source" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.092354 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.094648 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.094679 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.098535 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101093 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101132 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101355 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101378 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101472 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101482 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101496 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101504 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101909 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101919 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101930 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101943 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101955 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.101980 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.102813 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.102839 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.107717 2578 server.go:1268] "Started kubelet" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.108041 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.108116 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.108128 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.110756 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.111663 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-112.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.112262 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.112267 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.115117 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.114873 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-112.ec2.internal.18c0a8d1f26e80f6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-112.ec2.internal,UID:ip-10-0-128-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-112.ec2.internal,},FirstTimestamp:2026-07-09 15:31:12.107675894 +0000 UTC m=+0.395268587,LastTimestamp:2026-07-09 15:31:12.107675894 +0000 UTC m=+0.395268587,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-112.ec2.internal,}" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.118926 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.123752 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.123771 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.123829 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.124610 2578 factory.go:55] Registering systemd factory Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.124813 2578 factory.go:223] Registration of the systemd container factory successfully Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.124704 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.124705 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.124856 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.124986 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.124998 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 09 15:31:12.370910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.125038 2578 factory.go:153] Registering CRI-O factory Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.125048 2578 factory.go:223] Registration of the crio container factory successfully Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.125127 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.125153 2578 factory.go:103] Registering Raw factory Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.125167 2578 manager.go:1196] Started watching for new ooms in manager Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.127907 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.127934 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-112.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.133829 2578 manager.go:349] Starting recovery of all containers Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.167148 2578 manager.go:354] Recovery completed Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.171484 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.180748 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.180782 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.180794 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.181381 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.181393 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.181406 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.181409 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.182154 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.182184 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.182198 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.182834 2578 policy_none.go:49] "None policy: Start" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.182856 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.182875 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.184138 2578 policy_none.go:47] "Start" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.189752 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-112.ec2.internal.18c0a8d1f6c9ca0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-112.ec2.internal,UID:ip-10-0-128-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-112.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-112.ec2.internal,},FirstTimestamp:2026-07-09 15:31:12.180767244 +0000 UTC m=+0.468359935,LastTimestamp:2026-07-09 15:31:12.180767244 +0000 UTC m=+0.468359935,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-112.ec2.internal,}" Jul 09 15:31:12.390036 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.202452 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-112.ec2.internal.18c0a8d1f6ca16d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-112.ec2.internal,UID:ip-10-0-128-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-112.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-112.ec2.internal,},FirstTimestamp:2026-07-09 15:31:12.180786899 +0000 UTC m=+0.468379588,LastTimestamp:2026-07-09 15:31:12.180786899 +0000 UTC m=+0.468379588,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-112.ec2.internal,}" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.215016 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-112.ec2.internal.18c0a8d1f6ca420d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-112.ec2.internal,UID:ip-10-0-128-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-112.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-112.ec2.internal,},FirstTimestamp:2026-07-09 15:31:12.180797965 +0000 UTC m=+0.468390653,LastTimestamp:2026-07-09 15:31:12.180797965 +0000 UTC m=+0.468390653,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-112.ec2.internal,}" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.225967 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.231855 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-112.ec2.internal.18c0a8d1f6c9ca0c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-112.ec2.internal.18c0a8d1f6c9ca0c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-112.ec2.internal,UID:ip-10-0-128-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-112.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-112.ec2.internal,},FirstTimestamp:2026-07-09 15:31:12.180767244 +0000 UTC m=+0.468359935,LastTimestamp:2026-07-09 15:31:12.182166704 +0000 UTC m=+0.469759394,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-112.ec2.internal,}" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.245992 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-112.ec2.internal.18c0a8d1f6ca16d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-112.ec2.internal.18c0a8d1f6ca16d3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-112.ec2.internal,UID:ip-10-0-128-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-112.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-112.ec2.internal,},FirstTimestamp:2026-07-09 15:31:12.180786899 +0000 UTC m=+0.468379588,LastTimestamp:2026-07-09 15:31:12.182191587 +0000 UTC m=+0.469784276,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-112.ec2.internal,}" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.248716 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7gpjg" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.252304 2578 manager.go:337] "Starting Device Plugin manager" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.252353 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.252368 2578 server.go:87] "Starting device plugin registration server" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.252646 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.252657 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.252781 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.252863 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.252873 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.253466 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.253529 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.257135 2578 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-112.ec2.internal.18c0a8d1f6ca420d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-112.ec2.internal.18c0a8d1f6ca420d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-112.ec2.internal,UID:ip-10-0-128-112.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-112.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-112.ec2.internal,},FirstTimestamp:2026-07-09 15:31:12.180797965 +0000 UTC m=+0.468390653,LastTimestamp:2026-07-09 15:31:12.182202466 +0000 UTC m=+0.469795155,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-112.ec2.internal,}" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.259819 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7gpjg" Jul 09 15:31:12.390874 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.334428 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-112.ec2.internal\" not found" node="ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.353516 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.354482 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.354503 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.354513 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.354540 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.364199 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.364222 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-112.ec2.internal\": node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.382436 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.383609 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.383653 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.383681 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.383732 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.385588 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:31:12.391431 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.386410 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.484113 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal"] Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.484202 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.486031 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.486060 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.486070 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.487102 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.487445 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.487542 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.487565 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.489938 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.489963 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.489978 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.489986 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.489989 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.489997 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.491255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.491285 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.491990 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.492016 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.492030 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.510364 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-112.ec2.internal\" not found" node="ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.530068 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.516020 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-112.ec2.internal\" not found" node="ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.659907 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.587734 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.659907 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.633338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c7108f0b397480e47a0c18cbe8845d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal\" (UID: \"b1c7108f0b397480e47a0c18cbe8845d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.659907 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.633369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b440d2d8752bd70c3497ee880d25f6a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-112.ec2.internal\" (UID: \"0b440d2d8752bd70c3497ee880d25f6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.659907 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.633390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1c7108f0b397480e47a0c18cbe8845d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal\" (UID: \"b1c7108f0b397480e47a0c18cbe8845d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.745563 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.688410 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.745563 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.733884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c7108f0b397480e47a0c18cbe8845d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal\" (UID: \"b1c7108f0b397480e47a0c18cbe8845d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.745563 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.733916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b440d2d8752bd70c3497ee880d25f6a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-112.ec2.internal\" (UID: \"0b440d2d8752bd70c3497ee880d25f6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.745563 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.733936 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1c7108f0b397480e47a0c18cbe8845d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal\" (UID: \"b1c7108f0b397480e47a0c18cbe8845d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.745563 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.733977 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b1c7108f0b397480e47a0c18cbe8845d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal\" (UID: \"b1c7108f0b397480e47a0c18cbe8845d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.745563 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.733999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1c7108f0b397480e47a0c18cbe8845d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal\" (UID: \"b1c7108f0b397480e47a0c18cbe8845d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.745563 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.733999 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b440d2d8752bd70c3497ee880d25f6a-config\") pod \"kube-apiserver-proxy-ip-10-0-128-112.ec2.internal\" (UID: \"0b440d2d8752bd70c3497ee880d25f6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.867408 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.789007 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:12.867408 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.813174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:12.867408 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:12.819192 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" Jul 09 15:31:13.031994 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.889582 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:13.031994 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:12.990164 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:13.174147 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.049731 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 15:31:13.174147 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.049896 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:31:13.174147 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:13.091012 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:13.174147 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.157859 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:31:13.290932 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:13.192137 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-112.ec2.internal\" not found" Jul 09 15:31:13.290932 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.227079 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:31:13.290932 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.262438 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 15:26:12 +0000 UTC" deadline="2028-02-02 12:45:19.28475848 +0000 UTC" Jul 09 15:31:13.290932 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.262475 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13749h14m6.022287663s" Jul 09 15:31:13.397036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.324718 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" Jul 09 15:31:13.397036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.340059 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:31:13.397036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.341121 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" Jul 09 15:31:13.397036 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.348027 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:31:13.572902 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:13.572865 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b440d2d8752bd70c3497ee880d25f6a.slice/crio-5ee76995777f058fdea78aad3ec4c7fa2a796b0790d2355b44caeda1ddacd549 WatchSource:0}: Error finding container 5ee76995777f058fdea78aad3ec4c7fa2a796b0790d2355b44caeda1ddacd549: Status 404 returned error can't find the container with id 5ee76995777f058fdea78aad3ec4c7fa2a796b0790d2355b44caeda1ddacd549 Jul 09 15:31:13.573184 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:13.573166 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c7108f0b397480e47a0c18cbe8845d.slice/crio-b0d744f68da7888b0cc502f34964bfdff12674937f5ca16123b47db3d0fe1ba6 WatchSource:0}: Error finding container b0d744f68da7888b0cc502f34964bfdff12674937f5ca16123b47db3d0fe1ba6: Status 404 returned error can't find the container with id b0d744f68da7888b0cc502f34964bfdff12674937f5ca16123b47db3d0fe1ba6 Jul 09 15:31:13.577748 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.577731 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:31:13.702659 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:13.702631 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:31:14.093581 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.093552 2578 apiserver.go:52] "Watching apiserver" Jul 09 15:31:14.102825 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.102796 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 15:31:14.103219 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.103196 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal","openshift-cluster-node-tuning-operator/tuned-77ffp","openshift-dns/node-resolver-rphtv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal","openshift-multus/multus-additional-cni-plugins-pqrhk","openshift-multus/network-metrics-daemon-5xkpt","openshift-ovn-kubernetes/ovnkube-node-w7hnj","kube-system/global-pull-secret-syncer-vrps5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc","openshift-image-registry/node-ca-g6kp4","openshift-multus/multus-xk6f5","openshift-network-diagnostics/network-check-target-wzrgp","openshift-network-operator/iptables-alerter-w98np","kube-system/konnectivity-agent-7c6sc"] Jul 09 15:31:14.105590 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.105558 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.107124 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.107091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.108401 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.108379 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 15:31:14.108586 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.108563 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 15:31:14.108666 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.108649 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 15:31:14.108954 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.108938 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wl7hn\"" Jul 09 15:31:14.109040 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.108997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.109833 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.109799 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 15:31:14.110201 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.110176 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l8cv6\"" Jul 09 15:31:14.110306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.110201 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 15:31:14.110362 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.110322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:31:14.110519 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.110503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.111655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.111637 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.111773 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.111755 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 15:31:14.112582 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.112564 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xfpjk\"" Jul 09 15:31:14.112779 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.112765 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 15:31:14.112969 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.112954 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 15:31:14.113088 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.112978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:14.113088 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.112993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 15:31:14.113088 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.113057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5jh8v\"" Jul 09 15:31:14.113284 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.113094 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:14.113944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.113916 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 15:31:14.114023 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.113974 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 15:31:14.114205 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.114190 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qmmn6\"" Jul 09 15:31:14.114284 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.114230 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 15:31:14.114432 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.114418 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.114548 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.114533 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 15:31:14.114900 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.114884 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 15:31:14.115870 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.115854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.116806 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.116791 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 15:31:14.116886 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.116872 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 15:31:14.117081 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.117066 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 15:31:14.117304 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.117287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.117379 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.117341 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-njzql\"" Jul 09 15:31:14.118235 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.118216 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 15:31:14.118235 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.118231 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 15:31:14.118406 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.118239 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 15:31:14.118523 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.118508 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.118573 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.118556 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:14.118614 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.118515 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 15:31:14.118802 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.118786 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-pk4qz\"" Jul 09 15:31:14.118848 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.118804 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 15:31:14.119943 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.119922 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 15:31:14.120189 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.120174 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.120634 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.120611 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:31:14.120634 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.120617 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tbb8h\"" Jul 09 15:31:14.120904 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.120772 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 15:31:14.121574 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.121558 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:14.121648 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.121627 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:14.122412 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.122398 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 15:31:14.122815 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.122803 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8mtk\"" Jul 09 15:31:14.124795 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.124780 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 15:31:14.125952 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.125932 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 15:31:14.136322 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.136303 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:31:14.140344 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/158590de-96c7-40e6-bde3-a5e115670c8d-serviceca\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.140418 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140355 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d6f94e7-50a2-403a-8074-75a807af983f-host-slash\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.140418 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140377 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysctl-conf\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.140418 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-var-lib-kubelet\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.140536 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-host\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.140536 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140469 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf4mz\" (UniqueName: \"kubernetes.io/projected/97b8f217-e61a-4e65-9af1-7a368ccd3567-kube-api-access-zf4mz\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-socket-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-device-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.140993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-systemd-units\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-systemd\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-run\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3727e453-6ca2-4be8-bf44-d282c7a9d75f-tmp\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141188 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-systemd\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-log-socket\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-etc-selinux\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-system-cni-dir\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.141436 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141464 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-var-lib-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-ovn\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt5hk\" (UniqueName: \"kubernetes.io/projected/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-kube-api-access-qt5hk\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-kubernetes\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141645 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc84n\" (UniqueName: \"kubernetes.io/projected/83e27e52-cff5-4bc7-bb69-ad9404382a80-kube-api-access-mc84n\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/520ce4bf-58fc-4ac2-a718-eae2c7759ebd-agent-certs\") pod \"konnectivity-agent-7c6sc\" (UID: \"520ce4bf-58fc-4ac2-a718-eae2c7759ebd\") " pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-socket-dir-parent\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-kubelet\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-etc-kubernetes\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl44t\" (UniqueName: \"kubernetes.io/projected/926e363b-6345-4f81-8a29-34b04b5f86dd-kube-api-access-rl44t\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.141996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f7s4\" (UniqueName: \"kubernetes.io/projected/3d6f94e7-50a2-403a-8074-75a807af983f-kube-api-access-7f7s4\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-kubelet\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-lib-modules\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00d86721-e2ea-4598-a3a0-a84b11b71f54-dbus\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142162 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-cni-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142210 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d6f94e7-50a2-403a-8074-75a807af983f-iptables-alerter-script\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-697gc\" (UniqueName: \"kubernetes.io/projected/c9b8b3ea-7ca9-45eb-b194-70eead257c47-kube-api-access-697gc\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-cni-bin\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-cni-bin\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-daemon-config\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-node-log\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-run-ovn-kubernetes\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142531 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-env-overrides\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.142655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142576 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-cni-multus\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142664 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-multus-certs\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142725 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142752 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovnkube-config\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142882 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142918 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-hostroot\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbgxf\" (UniqueName: \"kubernetes.io/projected/c857fbaa-1128-476e-8881-e59a3c6e0d4b-kube-api-access-dbgxf\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.142974 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-etc-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-modprobe-d\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-system-cni-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-os-release\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-k8s-cni-cncf-io\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143180 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143168 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-netns\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-slash\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143240 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysconfig\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-sys-fs\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143332 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-cni-netd\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143360 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83e27e52-cff5-4bc7-bb69-ad9404382a80-tmp-dir\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-cnibin\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143411 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj9t2\" (UniqueName: \"kubernetes.io/projected/158590de-96c7-40e6-bde3-a5e115670c8d-kube-api-access-cj9t2\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143445 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143471 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovn-node-metrics-cert\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-sys\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rj2g\" (UniqueName: \"kubernetes.io/projected/3727e453-6ca2-4be8-bf44-d282c7a9d75f-kube-api-access-6rj2g\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143583 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-run-netns\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovnkube-script-lib\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysctl-d\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.143780 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143759 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-tuned\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83e27e52-cff5-4bc7-bb69-ad9404382a80-hosts-file\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143820 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/520ce4bf-58fc-4ac2-a718-eae2c7759ebd-konnectivity-ca\") pod \"konnectivity-agent-7c6sc\" (UID: \"520ce4bf-58fc-4ac2-a718-eae2c7759ebd\") " pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143889 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00d86721-e2ea-4598-a3a0-a84b11b71f54-kubelet-config\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143921 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-conf-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.143969 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-cnibin\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.144003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-os-release\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.144029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-registration-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.144057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/926e363b-6345-4f81-8a29-34b04b5f86dd-cni-binary-copy\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.144511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.144088 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/158590de-96c7-40e6-bde3-a5e115670c8d-host\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.161678 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.161657 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8z2tj" Jul 09 15:31:14.167762 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.167742 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8z2tj" Jul 09 15:31:14.244964 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.244921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d6f94e7-50a2-403a-8074-75a807af983f-host-slash\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.244964 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.244960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysctl-conf\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.244978 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-var-lib-kubelet\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.244996 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-host\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245052 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3d6f94e7-50a2-403a-8074-75a807af983f-host-slash\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245078 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf4mz\" (UniqueName: \"kubernetes.io/projected/97b8f217-e61a-4e65-9af1-7a368ccd3567-kube-api-access-zf4mz\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245062 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-var-lib-kubelet\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-socket-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245161 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysctl-conf\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245170 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-host\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-device-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.245238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245240 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-device-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245261 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-socket-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-systemd-units\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-systemd\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-run\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3727e453-6ca2-4be8-bf44-d282c7a9d75f-tmp\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245369 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-systemd-units\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245386 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-systemd\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-run\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245410 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-systemd\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-log-socket\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245461 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-log-socket\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245465 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-systemd\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245498 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-etc-selinux\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-system-cni-dir\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245544 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-etc-selinux\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.245788 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-var-lib-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245557 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-system-cni-dir\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-ovn\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245625 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245642 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-run-ovn\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245674 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt5hk\" (UniqueName: \"kubernetes.io/projected/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-kube-api-access-qt5hk\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245721 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-var-lib-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-kubernetes\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc84n\" (UniqueName: \"kubernetes.io/projected/83e27e52-cff5-4bc7-bb69-ad9404382a80-kube-api-access-mc84n\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245805 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/520ce4bf-58fc-4ac2-a718-eae2c7759ebd-agent-certs\") pod \"konnectivity-agent-7c6sc\" (UID: \"520ce4bf-58fc-4ac2-a718-eae2c7759ebd\") " pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-socket-dir-parent\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245838 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-kubernetes\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-kubelet\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245891 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-kubelet\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245898 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-socket-dir-parent\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245912 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-etc-kubernetes\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.246600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl44t\" (UniqueName: \"kubernetes.io/projected/926e363b-6345-4f81-8a29-34b04b5f86dd-kube-api-access-rl44t\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245956 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245965 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-etc-kubernetes\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.245983 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f7s4\" (UniqueName: \"kubernetes.io/projected/3d6f94e7-50a2-403a-8074-75a807af983f-kube-api-access-7f7s4\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-kubelet\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-lib-modules\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246061 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-cni-binary-copy\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00d86721-e2ea-4598-a3a0-a84b11b71f54-dbus\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-cni-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d6f94e7-50a2-403a-8074-75a807af983f-iptables-alerter-script\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246054 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-kubelet\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697gc\" (UniqueName: \"kubernetes.io/projected/c9b8b3ea-7ca9-45eb-b194-70eead257c47-kube-api-access-697gc\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246198 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-lib-modules\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-cni-bin\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246234 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/00d86721-e2ea-4598-a3a0-a84b11b71f54-dbus\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-cni-bin\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.247458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-daemon-config\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246281 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-cni-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246282 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-cni-bin\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-node-log\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-cni-bin\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246342 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-run-ovn-kubernetes\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-env-overrides\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246391 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-node-log\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-cni-multus\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246430 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-run-ovn-kubernetes\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-multus-certs\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246471 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-var-lib-cni-multus\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246594 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-multus-certs\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovnkube-config\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-hostroot\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.248259 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.246810 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246863 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3d6f94e7-50a2-403a-8074-75a807af983f-iptables-alerter-script\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-daemon-config\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.246907 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret podName:00d86721-e2ea-4598-a3a0-a84b11b71f54 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:14.746865896 +0000 UTC m=+3.034458588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret") pod "global-pull-secret-syncer-vrps5" (UID: "00d86721-e2ea-4598-a3a0-a84b11b71f54") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246909 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-env-overrides\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246920 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-hostroot\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.246928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbgxf\" (UniqueName: \"kubernetes.io/projected/c857fbaa-1128-476e-8881-e59a3c6e0d4b-kube-api-access-dbgxf\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.246956 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.247050 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs podName:c857fbaa-1128-476e-8881-e59a3c6e0d4b nodeName:}" failed. No retries permitted until 2026-07-09 15:31:14.7470326 +0000 UTC m=+3.034625289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs") pod "network-metrics-daemon-5xkpt" (UID: "c857fbaa-1128-476e-8881-e59a3c6e0d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-etc-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247152 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247167 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-modprobe-d\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-system-cni-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247199 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-etc-openvswitch\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-os-release\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-k8s-cni-cncf-io\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-system-cni-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247272 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-netns\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247275 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-modprobe-d\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247249 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovnkube-config\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247302 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-slash\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-k8s-cni-cncf-io\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247321 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-host-run-netns\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247287 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-os-release\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247344 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-slash\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysconfig\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247379 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247402 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-sys-fs\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-cni-netd\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysconfig\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83e27e52-cff5-4bc7-bb69-ad9404382a80-tmp-dir\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247468 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-sys-fs\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.249619 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-cnibin\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247520 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj9t2\" (UniqueName: \"kubernetes.io/projected/158590de-96c7-40e6-bde3-a5e115670c8d-kube-api-access-cj9t2\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247528 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-cni-netd\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovn-node-metrics-cert\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247584 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-cnibin\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-sys\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247639 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rj2g\" (UniqueName: \"kubernetes.io/projected/3727e453-6ca2-4be8-bf44-d282c7a9d75f-kube-api-access-6rj2g\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247664 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-run-netns\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247683 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83e27e52-cff5-4bc7-bb69-ad9404382a80-tmp-dir\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovnkube-script-lib\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysctl-d\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-tuned\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83e27e52-cff5-4bc7-bb69-ad9404382a80-hosts-file\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247807 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/520ce4bf-58fc-4ac2-a718-eae2c7759ebd-konnectivity-ca\") pod \"konnectivity-agent-7c6sc\" (UID: \"520ce4bf-58fc-4ac2-a718-eae2c7759ebd\") " pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247829 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00d86721-e2ea-4598-a3a0-a84b11b71f54-kubelet-config\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247851 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-conf-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.250144 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247876 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-cnibin\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-os-release\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-registration-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247929 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-sys\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247943 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/926e363b-6345-4f81-8a29-34b04b5f86dd-cni-binary-copy\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247963 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/158590de-96c7-40e6-bde3-a5e115670c8d-host\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247990 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/83e27e52-cff5-4bc7-bb69-ad9404382a80-hosts-file\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248009 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/158590de-96c7-40e6-bde3-a5e115670c8d-serviceca\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.247995 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/926e363b-6345-4f81-8a29-34b04b5f86dd-multus-conf-dir\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248135 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-sysctl-d\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248182 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-cnibin\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248237 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97b8f217-e61a-4e65-9af1-7a368ccd3567-os-release\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248290 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9b8b3ea-7ca9-45eb-b194-70eead257c47-registration-dir\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-host-run-netns\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248345 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/97b8f217-e61a-4e65-9af1-7a368ccd3567-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248399 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/158590de-96c7-40e6-bde3-a5e115670c8d-host\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248812 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/158590de-96c7-40e6-bde3-a5e115670c8d-serviceca\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248858 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/926e363b-6345-4f81-8a29-34b04b5f86dd-cni-binary-copy\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.250603 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248869 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/00d86721-e2ea-4598-a3a0-a84b11b71f54-kubelet-config\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.251136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.248885 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovnkube-script-lib\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.251136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.249226 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3727e453-6ca2-4be8-bf44-d282c7a9d75f-tmp\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.251136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.249359 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/520ce4bf-58fc-4ac2-a718-eae2c7759ebd-konnectivity-ca\") pod \"konnectivity-agent-7c6sc\" (UID: \"520ce4bf-58fc-4ac2-a718-eae2c7759ebd\") " pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.251136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.249492 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/520ce4bf-58fc-4ac2-a718-eae2c7759ebd-agent-certs\") pod \"konnectivity-agent-7c6sc\" (UID: \"520ce4bf-58fc-4ac2-a718-eae2c7759ebd\") " pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.251136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.250003 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-ovn-node-metrics-cert\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.251136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.250461 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3727e453-6ca2-4be8-bf44-d282c7a9d75f-etc-tuned\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.255064 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.255039 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:31:14.255064 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.255066 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:31:14.255320 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.255080 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c98l6 for pod openshift-network-diagnostics/network-check-target-wzrgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:14.255320 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.255170 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6 podName:0b51398d-8747-424c-96a7-fa84853cd050 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:14.755150696 +0000 UTC m=+3.042743382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c98l6" (UniqueName: "kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6") pod "network-check-target-wzrgp" (UID: "0b51398d-8747-424c-96a7-fa84853cd050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:14.257092 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.257054 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl44t\" (UniqueName: \"kubernetes.io/projected/926e363b-6345-4f81-8a29-34b04b5f86dd-kube-api-access-rl44t\") pod \"multus-xk6f5\" (UID: \"926e363b-6345-4f81-8a29-34b04b5f86dd\") " pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.257194 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.257143 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f7s4\" (UniqueName: \"kubernetes.io/projected/3d6f94e7-50a2-403a-8074-75a807af983f-kube-api-access-7f7s4\") pod \"iptables-alerter-w98np\" (UID: \"3d6f94e7-50a2-403a-8074-75a807af983f\") " pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.257289 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.257265 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt5hk\" (UniqueName: \"kubernetes.io/projected/42cc97fb-6cca-46a9-ace1-8060bbf1ade3-kube-api-access-qt5hk\") pod \"ovnkube-node-w7hnj\" (UID: \"42cc97fb-6cca-46a9-ace1-8060bbf1ade3\") " pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.257365 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.257350 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc84n\" (UniqueName: \"kubernetes.io/projected/83e27e52-cff5-4bc7-bb69-ad9404382a80-kube-api-access-mc84n\") pod \"node-resolver-rphtv\" (UID: \"83e27e52-cff5-4bc7-bb69-ad9404382a80\") " pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.257649 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.257629 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-697gc\" (UniqueName: \"kubernetes.io/projected/c9b8b3ea-7ca9-45eb-b194-70eead257c47-kube-api-access-697gc\") pod \"aws-ebs-csi-driver-node-mfjcc\" (UID: \"c9b8b3ea-7ca9-45eb-b194-70eead257c47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.257893 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.257877 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf4mz\" (UniqueName: \"kubernetes.io/projected/97b8f217-e61a-4e65-9af1-7a368ccd3567-kube-api-access-zf4mz\") pod \"multus-additional-cni-plugins-pqrhk\" (UID: \"97b8f217-e61a-4e65-9af1-7a368ccd3567\") " pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.262279 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.262245 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbgxf\" (UniqueName: \"kubernetes.io/projected/c857fbaa-1128-476e-8881-e59a3c6e0d4b-kube-api-access-dbgxf\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:14.262279 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.262254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rj2g\" (UniqueName: \"kubernetes.io/projected/3727e453-6ca2-4be8-bf44-d282c7a9d75f-kube-api-access-6rj2g\") pod \"tuned-77ffp\" (UID: \"3727e453-6ca2-4be8-bf44-d282c7a9d75f\") " pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.262478 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.262455 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj9t2\" (UniqueName: \"kubernetes.io/projected/158590de-96c7-40e6-bde3-a5e115670c8d-kube-api-access-cj9t2\") pod \"node-ca-g6kp4\" (UID: \"158590de-96c7-40e6-bde3-a5e115670c8d\") " pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.369670 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.369581 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:31:14.388969 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.388920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" event={"ID":"b1c7108f0b397480e47a0c18cbe8845d","Type":"ContainerStarted","Data":"b0d744f68da7888b0cc502f34964bfdff12674937f5ca16123b47db3d0fe1ba6"} Jul 09 15:31:14.390241 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.390209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" event={"ID":"0b440d2d8752bd70c3497ee880d25f6a","Type":"ContainerStarted","Data":"5ee76995777f058fdea78aad3ec4c7fa2a796b0790d2355b44caeda1ddacd549"} Jul 09 15:31:14.416681 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.416650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g6kp4" Jul 09 15:31:14.424118 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.424085 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w98np" Jul 09 15:31:14.424418 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.424393 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod158590de_96c7_40e6_bde3_a5e115670c8d.slice/crio-14bd4b11ab260bfb4f54aec20e121be34382f8f2f8281dd2fd11ed6d8c45f43b WatchSource:0}: Error finding container 14bd4b11ab260bfb4f54aec20e121be34382f8f2f8281dd2fd11ed6d8c45f43b: Status 404 returned error can't find the container with id 14bd4b11ab260bfb4f54aec20e121be34382f8f2f8281dd2fd11ed6d8c45f43b Jul 09 15:31:14.431402 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.431236 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rphtv" Jul 09 15:31:14.432149 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.432120 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6f94e7_50a2_403a_8074_75a807af983f.slice/crio-a6bde1790dbaccfc741b8a6b1eedcbc5eb1b531315eb0d8933631dd53dd85070 WatchSource:0}: Error finding container a6bde1790dbaccfc741b8a6b1eedcbc5eb1b531315eb0d8933631dd53dd85070: Status 404 returned error can't find the container with id a6bde1790dbaccfc741b8a6b1eedcbc5eb1b531315eb0d8933631dd53dd85070 Jul 09 15:31:14.435732 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.435684 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:14.439960 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.439928 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83e27e52_cff5_4bc7_bb69_ad9404382a80.slice/crio-a8cddd3a33a40b448cc33e76c06ad5b42de9f9a4fc92d1664848cc14e244ac83 WatchSource:0}: Error finding container a8cddd3a33a40b448cc33e76c06ad5b42de9f9a4fc92d1664848cc14e244ac83: Status 404 returned error can't find the container with id a8cddd3a33a40b448cc33e76c06ad5b42de9f9a4fc92d1664848cc14e244ac83 Jul 09 15:31:14.441642 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.441610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" Jul 09 15:31:14.447402 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.447376 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520ce4bf_58fc_4ac2_a718_eae2c7759ebd.slice/crio-cac401679fac93d2be9fb3eb847e339cee89597a7bdc90a8be79c16943eedf15 WatchSource:0}: Error finding container cac401679fac93d2be9fb3eb847e339cee89597a7bdc90a8be79c16943eedf15: Status 404 returned error can't find the container with id cac401679fac93d2be9fb3eb847e339cee89597a7bdc90a8be79c16943eedf15 Jul 09 15:31:14.448803 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.448785 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" Jul 09 15:31:14.450518 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.450492 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b8f217_e61a_4e65_9af1_7a368ccd3567.slice/crio-7517a27301a6974975f575ba61cc2875eb1d45748fd5bc47f72165c5768f495f WatchSource:0}: Error finding container 7517a27301a6974975f575ba61cc2875eb1d45748fd5bc47f72165c5768f495f: Status 404 returned error can't find the container with id 7517a27301a6974975f575ba61cc2875eb1d45748fd5bc47f72165c5768f495f Jul 09 15:31:14.453568 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.453551 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:14.457207 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.457183 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b8b3ea_7ca9_45eb_b194_70eead257c47.slice/crio-f83b26d84fe31a9e96a8268727b6634d4e9d769782205ea5a5571f30ef9a55e1 WatchSource:0}: Error finding container f83b26d84fe31a9e96a8268727b6634d4e9d769782205ea5a5571f30ef9a55e1: Status 404 returned error can't find the container with id f83b26d84fe31a9e96a8268727b6634d4e9d769782205ea5a5571f30ef9a55e1 Jul 09 15:31:14.458737 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.458715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-77ffp" Jul 09 15:31:14.461447 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.461421 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42cc97fb_6cca_46a9_ace1_8060bbf1ade3.slice/crio-6157be631d30c7cf1826a05b4ccb3c655ad5083a39601c3bb99e2e6281571084 WatchSource:0}: Error finding container 6157be631d30c7cf1826a05b4ccb3c655ad5083a39601c3bb99e2e6281571084: Status 404 returned error can't find the container with id 6157be631d30c7cf1826a05b4ccb3c655ad5083a39601c3bb99e2e6281571084 Jul 09 15:31:14.463148 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.463132 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xk6f5" Jul 09 15:31:14.466056 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.466025 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3727e453_6ca2_4be8_bf44_d282c7a9d75f.slice/crio-3c2ecf9b657fca2ae88e29d7e382255cc424b4daf59b9cbfe680e9d88c50f577 WatchSource:0}: Error finding container 3c2ecf9b657fca2ae88e29d7e382255cc424b4daf59b9cbfe680e9d88c50f577: Status 404 returned error can't find the container with id 3c2ecf9b657fca2ae88e29d7e382255cc424b4daf59b9cbfe680e9d88c50f577 Jul 09 15:31:14.471973 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:14.471953 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926e363b_6345_4f81_8a29_34b04b5f86dd.slice/crio-3bcf9f34954c68424a28e109b8e1f8b45ca5bcf422980d39eb84fcbc87d42171 WatchSource:0}: Error finding container 3bcf9f34954c68424a28e109b8e1f8b45ca5bcf422980d39eb84fcbc87d42171: Status 404 returned error can't find the container with id 3bcf9f34954c68424a28e109b8e1f8b45ca5bcf422980d39eb84fcbc87d42171 Jul 09 15:31:14.751391 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.751280 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:14.751391 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.751317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:14.751601 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.751452 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:14.751601 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.751457 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:14.751601 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.751524 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret podName:00d86721-e2ea-4598-a3a0-a84b11b71f54 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:15.751500661 +0000 UTC m=+4.039093337 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret") pod "global-pull-secret-syncer-vrps5" (UID: "00d86721-e2ea-4598-a3a0-a84b11b71f54") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:14.751601 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.751537 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs podName:c857fbaa-1128-476e-8881-e59a3c6e0d4b nodeName:}" failed. No retries permitted until 2026-07-09 15:31:15.751530972 +0000 UTC m=+4.039123648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs") pod "network-metrics-daemon-5xkpt" (UID: "c857fbaa-1128-476e-8881-e59a3c6e0d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:14.852524 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:14.852484 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:14.852730 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.852646 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:31:14.852730 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.852671 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:31:14.852730 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.852681 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c98l6 for pod openshift-network-diagnostics/network-check-target-wzrgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:14.852861 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:14.852749 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6 podName:0b51398d-8747-424c-96a7-fa84853cd050 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:15.852733411 +0000 UTC m=+4.140326087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c98l6" (UniqueName: "kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6") pod "network-check-target-wzrgp" (UID: "0b51398d-8747-424c-96a7-fa84853cd050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:15.170462 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.170354 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:26:14 +0000 UTC" deadline="2027-12-09 08:07:18.786162905 +0000 UTC" Jul 09 15:31:15.170462 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.170396 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12424h36m3.615771811s" Jul 09 15:31:15.384984 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.384932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:15.385160 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.385096 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:15.385555 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.385533 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:15.385728 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.385642 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:15.394546 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.394519 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7c6sc" event={"ID":"520ce4bf-58fc-4ac2-a718-eae2c7759ebd","Type":"ContainerStarted","Data":"cac401679fac93d2be9fb3eb847e339cee89597a7bdc90a8be79c16943eedf15"} Jul 09 15:31:15.396433 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.396380 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w98np" event={"ID":"3d6f94e7-50a2-403a-8074-75a807af983f","Type":"ContainerStarted","Data":"a6bde1790dbaccfc741b8a6b1eedcbc5eb1b531315eb0d8933631dd53dd85070"} Jul 09 15:31:15.397723 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.397700 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rphtv" event={"ID":"83e27e52-cff5-4bc7-bb69-ad9404382a80","Type":"ContainerStarted","Data":"a8cddd3a33a40b448cc33e76c06ad5b42de9f9a4fc92d1664848cc14e244ac83"} Jul 09 15:31:15.399439 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.399415 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6kp4" event={"ID":"158590de-96c7-40e6-bde3-a5e115670c8d","Type":"ContainerStarted","Data":"14bd4b11ab260bfb4f54aec20e121be34382f8f2f8281dd2fd11ed6d8c45f43b"} Jul 09 15:31:15.401097 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.401072 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xk6f5" event={"ID":"926e363b-6345-4f81-8a29-34b04b5f86dd","Type":"ContainerStarted","Data":"3bcf9f34954c68424a28e109b8e1f8b45ca5bcf422980d39eb84fcbc87d42171"} Jul 09 15:31:15.403234 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.403208 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77ffp" event={"ID":"3727e453-6ca2-4be8-bf44-d282c7a9d75f","Type":"ContainerStarted","Data":"3c2ecf9b657fca2ae88e29d7e382255cc424b4daf59b9cbfe680e9d88c50f577"} Jul 09 15:31:15.412723 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.412671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"6157be631d30c7cf1826a05b4ccb3c655ad5083a39601c3bb99e2e6281571084"} Jul 09 15:31:15.415634 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.415606 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" event={"ID":"c9b8b3ea-7ca9-45eb-b194-70eead257c47","Type":"ContainerStarted","Data":"f83b26d84fe31a9e96a8268727b6634d4e9d769782205ea5a5571f30ef9a55e1"} Jul 09 15:31:15.417719 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.417679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerStarted","Data":"7517a27301a6974975f575ba61cc2875eb1d45748fd5bc47f72165c5768f495f"} Jul 09 15:31:15.760519 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.760479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:15.760519 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.760529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:15.761063 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.760659 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:15.761063 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.760742 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret podName:00d86721-e2ea-4598-a3a0-a84b11b71f54 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:17.76072346 +0000 UTC m=+6.048316154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret") pod "global-pull-secret-syncer-vrps5" (UID: "00d86721-e2ea-4598-a3a0-a84b11b71f54") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:15.761063 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.760802 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:15.761063 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.760846 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs podName:c857fbaa-1128-476e-8881-e59a3c6e0d4b nodeName:}" failed. No retries permitted until 2026-07-09 15:31:17.760833433 +0000 UTC m=+6.048426131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs") pod "network-metrics-daemon-5xkpt" (UID: "c857fbaa-1128-476e-8881-e59a3c6e0d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:15.861921 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:15.861879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:15.862171 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.862151 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:31:15.862258 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.862178 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:31:15.862258 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.862191 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c98l6 for pod openshift-network-diagnostics/network-check-target-wzrgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:15.862258 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:15.862251 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6 podName:0b51398d-8747-424c-96a7-fa84853cd050 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:17.862232945 +0000 UTC m=+6.149825625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c98l6" (UniqueName: "kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6") pod "network-check-target-wzrgp" (UID: "0b51398d-8747-424c-96a7-fa84853cd050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:16.170969 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:16.170863 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:26:14 +0000 UTC" deadline="2028-01-07 05:37:21.462236565 +0000 UTC" Jul 09 15:31:16.170969 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:16.170933 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13118h6m5.291308175s" Jul 09 15:31:16.387315 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:16.386785 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:16.387315 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:16.386911 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:17.384772 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:17.384736 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:17.385240 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:17.384942 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:17.385240 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.385042 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:17.385467 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.385431 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:17.777218 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:17.777131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:17.777218 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:17.777179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:17.777486 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.777292 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:17.777486 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.777305 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:17.777486 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.777363 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret podName:00d86721-e2ea-4598-a3a0-a84b11b71f54 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:21.777345565 +0000 UTC m=+10.064938241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret") pod "global-pull-secret-syncer-vrps5" (UID: "00d86721-e2ea-4598-a3a0-a84b11b71f54") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:17.777486 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.777384 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs podName:c857fbaa-1128-476e-8881-e59a3c6e0d4b nodeName:}" failed. No retries permitted until 2026-07-09 15:31:21.777373307 +0000 UTC m=+10.064965986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs") pod "network-metrics-daemon-5xkpt" (UID: "c857fbaa-1128-476e-8881-e59a3c6e0d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:17.878542 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:17.878497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:17.878737 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.878721 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:31:17.878807 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.878751 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:31:17.878807 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.878766 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c98l6 for pod openshift-network-diagnostics/network-check-target-wzrgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:17.878902 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:17.878837 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6 podName:0b51398d-8747-424c-96a7-fa84853cd050 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:21.878815874 +0000 UTC m=+10.166408567 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c98l6" (UniqueName: "kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6") pod "network-check-target-wzrgp" (UID: "0b51398d-8747-424c-96a7-fa84853cd050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:18.384945 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:18.384909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:18.385376 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:18.385066 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:19.384081 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:19.384045 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:19.384245 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:19.384093 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:19.384245 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:19.384198 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:19.384338 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:19.384319 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:20.385081 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:20.384979 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:20.385508 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:20.385126 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:21.384798 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:21.384749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:21.384968 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:21.384755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:21.384968 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.384897 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:21.384968 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.384949 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:21.812488 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:21.812427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:21.812646 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:21.812493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:21.812720 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.812658 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:21.812769 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.812743 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret podName:00d86721-e2ea-4598-a3a0-a84b11b71f54 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:29.812722687 +0000 UTC m=+18.100315386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret") pod "global-pull-secret-syncer-vrps5" (UID: "00d86721-e2ea-4598-a3a0-a84b11b71f54") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:21.813029 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.812947 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:21.813029 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.812999 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs podName:c857fbaa-1128-476e-8881-e59a3c6e0d4b nodeName:}" failed. No retries permitted until 2026-07-09 15:31:29.812984911 +0000 UTC m=+18.100577598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs") pod "network-metrics-daemon-5xkpt" (UID: "c857fbaa-1128-476e-8881-e59a3c6e0d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:21.913217 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:21.913176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:21.913381 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.913360 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:31:21.913455 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.913387 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:31:21.913455 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.913400 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c98l6 for pod openshift-network-diagnostics/network-check-target-wzrgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:21.913553 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:21.913469 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6 podName:0b51398d-8747-424c-96a7-fa84853cd050 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:29.91344818 +0000 UTC m=+18.201040876 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c98l6" (UniqueName: "kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6") pod "network-check-target-wzrgp" (UID: "0b51398d-8747-424c-96a7-fa84853cd050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:22.385414 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:22.385380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:22.385876 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:22.385489 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:23.384732 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:23.384635 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:23.384898 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:23.384809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:23.385151 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:23.384634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:23.385288 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:23.385241 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:24.384982 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:24.384891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:24.385408 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:24.385049 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:24.436320 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:24.436288 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" event={"ID":"c9b8b3ea-7ca9-45eb-b194-70eead257c47","Type":"ContainerStarted","Data":"9c2ce1aa33091bf9a5278d1d17adb2cc484d1993c2a093a0b3d9111414bad9e7"} Jul 09 15:31:24.437757 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:24.437724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" event={"ID":"0b440d2d8752bd70c3497ee880d25f6a","Type":"ContainerStarted","Data":"f4b31226973d9fe706e1676155504f2be0f4cf45c9e8425bb4b99975177c8405"} Jul 09 15:31:24.439266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:24.439211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g6kp4" event={"ID":"158590de-96c7-40e6-bde3-a5e115670c8d","Type":"ContainerStarted","Data":"396edf20bcb5cfaae2c3b717aadec407c5a5d120f8ebb13ca635d0e5de8407d9"} Jul 09 15:31:24.457951 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:24.457886 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-112.ec2.internal" podStartSLOduration=11.45786594 podStartE2EDuration="11.45786594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:24.457120188 +0000 UTC m=+12.744712887" watchObservedRunningTime="2026-07-09 15:31:24.45786594 +0000 UTC m=+12.745458639" Jul 09 15:31:25.384880 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.384670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:25.385062 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.384701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:25.385062 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:25.385009 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:25.385062 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:25.385025 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:25.454837 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.454795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-77ffp" event={"ID":"3727e453-6ca2-4be8-bf44-d282c7a9d75f","Type":"ContainerStarted","Data":"b3b6ccbd0357fdf47a16d4fa5da33f7d3926104daade5776ded7e5e7a6701751"} Jul 09 15:31:25.458644 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.458611 2578 generic.go:356] "Generic (PLEG): container finished" podID="97b8f217-e61a-4e65-9af1-7a368ccd3567" containerID="fb5bb44a04d0024073a276974f9ee9ce56846cdee05a30fc5fad511a7d2469c8" exitCode=0 Jul 09 15:31:25.458828 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.458715 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerDied","Data":"fb5bb44a04d0024073a276974f9ee9ce56846cdee05a30fc5fad511a7d2469c8"} Jul 09 15:31:25.463582 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.462972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7c6sc" event={"ID":"520ce4bf-58fc-4ac2-a718-eae2c7759ebd","Type":"ContainerStarted","Data":"f95ae06f075e64c24e62fa21d7377d64c3554213e50f634042b86d9d87f3ecea"} Jul 09 15:31:25.465669 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.465642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rphtv" event={"ID":"83e27e52-cff5-4bc7-bb69-ad9404382a80","Type":"ContainerStarted","Data":"5620085a3c21884def310993019b9aed4879e01ff39370da2fbd993fd1624ae2"} Jul 09 15:31:25.468396 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.468373 2578 generic.go:356] "Generic (PLEG): container finished" podID="b1c7108f0b397480e47a0c18cbe8845d" containerID="36f7d5943712c38a85f21acf3d943ec22c0ee0487cbbe1d9ffa9ff73322beb09" exitCode=0 Jul 09 15:31:25.469013 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.468984 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" event={"ID":"b1c7108f0b397480e47a0c18cbe8845d","Type":"ContainerDied","Data":"36f7d5943712c38a85f21acf3d943ec22c0ee0487cbbe1d9ffa9ff73322beb09"} Jul 09 15:31:25.477523 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.475449 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-77ffp" podStartSLOduration=4.094504388 podStartE2EDuration="13.475432435s" totalImagesPullingTime="9.380928047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:25.475026454 +0000 UTC m=+13.762619153" watchObservedRunningTime="2026-07-09 15:31:25.475432435 +0000 UTC m=+13.763025136" Jul 09 15:31:25.478567 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.478523 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g6kp4" podStartSLOduration=4.089826279 podStartE2EDuration="13.478501682s" totalImagesPullingTime="9.388675403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:24.477240649 +0000 UTC m=+12.764833348" watchObservedRunningTime="2026-07-09 15:31:25.478501682 +0000 UTC m=+13.766094380" Jul 09 15:31:25.491458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.491403 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rphtv" podStartSLOduration=3.150019588 podStartE2EDuration="13.491386786s" totalImagesPullingTime="10.341367198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:25.491002372 +0000 UTC m=+13.778595082" watchObservedRunningTime="2026-07-09 15:31:25.491386786 +0000 UTC m=+13.778979486" Jul 09 15:31:25.512530 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.512468 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7c6sc" podStartSLOduration=3.02535828 podStartE2EDuration="13.512451847s" totalImagesPullingTime="10.487093567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:25.510810782 +0000 UTC m=+13.798403482" watchObservedRunningTime="2026-07-09 15:31:25.512451847 +0000 UTC m=+13.800044545" Jul 09 15:31:25.871196 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:25.871163 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 15:31:26.261291 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.261132 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T15:31:25.87118751Z","UUID":"114e1019-e0a3-4be0-a45b-3f3df7f28869","Handler":null,"Name":"","Endpoint":""} Jul 09 15:31:26.263091 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.263058 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 15:31:26.263091 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.263091 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 15:31:26.384786 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.384756 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:26.384975 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:26.384885 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:26.473588 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.473499 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" event={"ID":"b1c7108f0b397480e47a0c18cbe8845d","Type":"ContainerStarted","Data":"440e9c3376191627fe263f34ccf18dc34b9f129fb8be57856f8b4228dd0fa4b6"} Jul 09 15:31:26.475754 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.475723 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" event={"ID":"c9b8b3ea-7ca9-45eb-b194-70eead257c47","Type":"ContainerStarted","Data":"f0dad4c727fd9e204a4b7912e2159b913c8a85fd010eadf0b8a3329068f1f32a"} Jul 09 15:31:26.477744 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.477709 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w98np" event={"ID":"3d6f94e7-50a2-403a-8074-75a807af983f","Type":"ContainerStarted","Data":"cbbe32728c7ae97090cab98c2bd531339fc49c1ce63b4f5cd9aafc919c05fe2c"} Jul 09 15:31:26.490466 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.490406 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-112.ec2.internal" podStartSLOduration=13.490386434 podStartE2EDuration="13.490386434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:26.489867699 +0000 UTC m=+14.777460399" watchObservedRunningTime="2026-07-09 15:31:26.490386434 +0000 UTC m=+14.777979133" Jul 09 15:31:26.512196 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:26.512090 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w98np" podStartSLOduration=5.131422771 podStartE2EDuration="14.512075003s" totalImagesPullingTime="9.380652232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:26.511587652 +0000 UTC m=+14.799180350" watchObservedRunningTime="2026-07-09 15:31:26.512075003 +0000 UTC m=+14.799667702" Jul 09 15:31:27.384093 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:27.384063 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:27.384232 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:27.384070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:27.384232 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:27.384182 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:27.384336 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:27.384282 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:28.336237 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:28.336190 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:28.336820 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:28.336792 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:28.384399 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:28.384361 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:28.384576 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:28.384491 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:28.484367 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:28.484325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" event={"ID":"c9b8b3ea-7ca9-45eb-b194-70eead257c47","Type":"ContainerStarted","Data":"96d4ac3935eeadf0c920809c293828c2aecdc2200cb221d8edb5c46cd712873b"} Jul 09 15:31:28.484552 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:28.484522 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:28.485131 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:28.485106 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7c6sc" Jul 09 15:31:28.504520 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:28.504462 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mfjcc" podStartSLOduration=4.007356327 podStartE2EDuration="16.5044436s" totalImagesPullingTime="12.497087273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:28.503889296 +0000 UTC m=+16.791482082" watchObservedRunningTime="2026-07-09 15:31:28.5044436 +0000 UTC m=+16.792036298" Jul 09 15:31:29.384392 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:29.384354 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:29.385080 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.384487 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:29.385080 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:29.384369 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:29.385080 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.384832 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:29.878458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:29.878424 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:29.878458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:29.878464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:29.878716 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.878586 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:29.878716 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.878647 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret podName:00d86721-e2ea-4598-a3a0-a84b11b71f54 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:45.87863415 +0000 UTC m=+34.166226826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret") pod "global-pull-secret-syncer-vrps5" (UID: "00d86721-e2ea-4598-a3a0-a84b11b71f54") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:29.878716 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.878586 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:29.878840 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.878746 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs podName:c857fbaa-1128-476e-8881-e59a3c6e0d4b nodeName:}" failed. No retries permitted until 2026-07-09 15:31:45.878733735 +0000 UTC m=+34.166326427 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs") pod "network-metrics-daemon-5xkpt" (UID: "c857fbaa-1128-476e-8881-e59a3c6e0d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:29.979806 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:29.979749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:29.980000 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.979894 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:31:29.980000 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.979924 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:31:29.980000 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.979938 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c98l6 for pod openshift-network-diagnostics/network-check-target-wzrgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:29.980145 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:29.980005 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6 podName:0b51398d-8747-424c-96a7-fa84853cd050 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:45.979985909 +0000 UTC m=+34.267578587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c98l6" (UniqueName: "kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6") pod "network-check-target-wzrgp" (UID: "0b51398d-8747-424c-96a7-fa84853cd050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:30.384416 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:30.384376 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:30.384865 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:30.384547 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:31.384662 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:31.384626 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:31.384662 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:31.384648 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:31.385208 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:31.384777 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:31.385208 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:31.384913 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:32.385235 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:32.385203 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:32.385722 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:32.385314 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:33.384204 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:33.384172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:33.384384 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:33.384173 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:33.384384 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:33.384284 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:33.384523 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:33.384379 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:34.384811 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:34.384775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:34.385432 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:34.384920 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:35.384857 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:35.384808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:35.385443 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:35.384827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:35.385443 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:35.384978 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:35.385443 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:35.385079 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:36.384740 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:36.384701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:36.384931 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:36.384835 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:37.384419 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:37.384382 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:37.384613 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:37.384388 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:37.384613 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:37.384533 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:37.384613 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:37.384583 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:38.384970 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.384720 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:38.385315 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:38.385103 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:38.509092 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.509071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:31:38.509425 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.509398 2578 generic.go:356] "Generic (PLEG): container finished" podID="42cc97fb-6cca-46a9-ace1-8060bbf1ade3" containerID="3998ae4bb314c26a7776510c1d877b72d22089e9a0b099fe1f2e76ba4eaeee60" exitCode=1 Jul 09 15:31:38.509519 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.509454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"2b8234d6449e3d0b85d985e211d28f571b682de2d04972f5b0724775f17ff921"} Jul 09 15:31:38.509579 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.509528 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerDied","Data":"3998ae4bb314c26a7776510c1d877b72d22089e9a0b099fe1f2e76ba4eaeee60"} Jul 09 15:31:38.509579 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.509567 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"df87e410e0be24cc4eb8f70d3bc930af7812fff27f98439b60b46ba83a769abe"} Jul 09 15:31:38.511129 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.511107 2578 generic.go:356] "Generic (PLEG): container finished" podID="97b8f217-e61a-4e65-9af1-7a368ccd3567" containerID="68a80355513f986a1f24e5072fbf76ac8fa260d0d7e09b52eec0835003b46e4f" exitCode=0 Jul 09 15:31:38.511227 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.511196 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerDied","Data":"68a80355513f986a1f24e5072fbf76ac8fa260d0d7e09b52eec0835003b46e4f"} Jul 09 15:31:38.512644 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.512624 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xk6f5" event={"ID":"926e363b-6345-4f81-8a29-34b04b5f86dd","Type":"ContainerStarted","Data":"d7ce16d277ea494c328d16e584d166394d816eefba418433218dbdc1596f9ee5"} Jul 09 15:31:38.552159 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:38.552107 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xk6f5" podStartSLOduration=2.891331965 podStartE2EDuration="26.552092167s" totalImagesPullingTime="23.660760202s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:38.551422145 +0000 UTC m=+26.839014844" watchObservedRunningTime="2026-07-09 15:31:38.552092167 +0000 UTC m=+26.839684861" Jul 09 15:31:39.384186 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:39.384156 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:39.384354 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:39.384260 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:39.384354 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:39.384319 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:39.384438 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:39.384418 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:39.517592 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:39.517522 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:31:39.518333 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:39.517869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"25f5e817f0f4417273170e3ce18a1962241c5f0a2a312b0ede697126bb37f161"} Jul 09 15:31:39.518333 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:39.517942 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"451de0bb38c5dd4e95313aba77654cd44910a3ce50f85e1a140edaad6d1b4fb3"} Jul 09 15:31:39.518333 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:39.517972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"c96462384ca50329d64084a4ed5ccee0458a0d17c7b10fb13b1e79b3f9965980"} Jul 09 15:31:40.385128 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:40.384862 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:40.385338 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:40.385172 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:40.522205 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:40.522165 2578 generic.go:356] "Generic (PLEG): container finished" podID="97b8f217-e61a-4e65-9af1-7a368ccd3567" containerID="5d336464514014e41a29eb3032fe5b7924969dcc208b16afcd2f5b725f605255" exitCode=0 Jul 09 15:31:40.522625 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:40.522215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerDied","Data":"5d336464514014e41a29eb3032fe5b7924969dcc208b16afcd2f5b725f605255"} Jul 09 15:31:41.384368 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:41.384332 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:41.384529 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:41.384351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:41.384529 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:41.384473 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:41.384529 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:41.384510 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:41.526864 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:41.526838 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:31:41.527291 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:41.527228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"770502ffe78f02ea945326ee461575dd14418294033ef4e0c536cd551005996e"} Jul 09 15:31:42.387297 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:42.387270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:42.387468 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:42.387358 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:42.531958 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:42.531920 2578 generic.go:356] "Generic (PLEG): container finished" podID="97b8f217-e61a-4e65-9af1-7a368ccd3567" containerID="636097f548b38a8259aaae549fb264951685f475a0c1ebdf8ccc4b6f4c65f305" exitCode=0 Jul 09 15:31:42.532331 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:42.531991 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerDied","Data":"636097f548b38a8259aaae549fb264951685f475a0c1ebdf8ccc4b6f4c65f305"} Jul 09 15:31:43.384494 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.384458 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:43.384657 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.384467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:43.384657 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:43.384576 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:43.384747 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:43.384703 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:43.537697 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.537658 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:31:43.538157 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.538041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"21580b622d9f163541d9df832be716566bb67a641976776d4fba3f7abea730b6"} Jul 09 15:31:43.538357 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.538328 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:43.538437 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.538406 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:43.538611 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.538596 2578 scope.go:117] "RemoveContainer" containerID="3998ae4bb314c26a7776510c1d877b72d22089e9a0b099fe1f2e76ba4eaeee60" Jul 09 15:31:43.556035 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:43.556013 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:44.384656 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:44.384597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:44.384849 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:44.384785 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:44.544884 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:44.544854 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:31:44.545298 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:44.545268 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" event={"ID":"42cc97fb-6cca-46a9-ace1-8060bbf1ade3","Type":"ContainerStarted","Data":"195908cb71f336ac2839c9f25248fe674aa50f3ca966917766467654c5f87b96"} Jul 09 15:31:44.545646 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:44.545622 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:44.564153 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:44.564129 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:31:44.578847 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:44.578795 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" podStartSLOduration=8.915126516 podStartE2EDuration="32.578779048s" totalImagesPullingTime="23.663652532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:44.57821901 +0000 UTC m=+32.865811714" watchObservedRunningTime="2026-07-09 15:31:44.578779048 +0000 UTC m=+32.866371746" Jul 09 15:31:45.375387 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.375191 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzrgp"] Jul 09 15:31:45.375562 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.375456 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:45.375562 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.375541 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:45.383212 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.383183 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrps5"] Jul 09 15:31:45.383345 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.383313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:45.383459 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.383433 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:45.383995 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.383969 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5xkpt"] Jul 09 15:31:45.384103 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.384070 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:45.384182 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.384150 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:45.893666 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.893624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:45.893666 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.893671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:45.894202 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.893823 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:45.894202 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.893828 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:45.894202 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.893891 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret podName:00d86721-e2ea-4598-a3a0-a84b11b71f54 nodeName:}" failed. No retries permitted until 2026-07-09 15:32:17.893872351 +0000 UTC m=+66.181465029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret") pod "global-pull-secret-syncer-vrps5" (UID: "00d86721-e2ea-4598-a3a0-a84b11b71f54") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:31:45.894202 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.893915 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs podName:c857fbaa-1128-476e-8881-e59a3c6e0d4b nodeName:}" failed. No retries permitted until 2026-07-09 15:32:17.893904255 +0000 UTC m=+66.181496933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs") pod "network-metrics-daemon-5xkpt" (UID: "c857fbaa-1128-476e-8881-e59a3c6e0d4b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:31:45.994541 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:45.994455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:45.994736 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.994674 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:31:45.994736 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.994715 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:31:45.994736 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.994726 2578 projected.go:196] Error preparing data for projected volume kube-api-access-c98l6 for pod openshift-network-diagnostics/network-check-target-wzrgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:45.994913 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:45.994793 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6 podName:0b51398d-8747-424c-96a7-fa84853cd050 nodeName:}" failed. No retries permitted until 2026-07-09 15:32:17.994774681 +0000 UTC m=+66.282367361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c98l6" (UniqueName: "kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6") pod "network-check-target-wzrgp" (UID: "0b51398d-8747-424c-96a7-fa84853cd050") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:31:47.384992 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:47.384905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:47.385529 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:47.384905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:47.385529 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:47.385060 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:47.385529 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:47.385084 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:47.385529 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:47.385183 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:47.385529 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:47.385256 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:48.558568 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:48.558518 2578 generic.go:356] "Generic (PLEG): container finished" podID="97b8f217-e61a-4e65-9af1-7a368ccd3567" containerID="05193d68ea11a408f648bec2b229d1bf41c453985a3d9cee26afd6921fa454df" exitCode=0 Jul 09 15:31:48.559232 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:48.558588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerDied","Data":"05193d68ea11a408f648bec2b229d1bf41c453985a3d9cee26afd6921fa454df"} Jul 09 15:31:49.384095 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:49.384059 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:49.384245 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:49.384060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:49.384245 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:49.384177 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:49.384318 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:49.384270 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:49.384318 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:49.384068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:49.384420 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:49.384372 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:49.564030 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:49.563992 2578 generic.go:356] "Generic (PLEG): container finished" podID="97b8f217-e61a-4e65-9af1-7a368ccd3567" containerID="2db87125acce4c58c0ec1555964247162c94ee4aa1f87bcff5e15cf8ddc028fa" exitCode=0 Jul 09 15:31:49.564644 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:49.564050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerDied","Data":"2db87125acce4c58c0ec1555964247162c94ee4aa1f87bcff5e15cf8ddc028fa"} Jul 09 15:31:50.384945 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:50.384908 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:50.385104 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:50.385076 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5xkpt" podUID="c857fbaa-1128-476e-8881-e59a3c6e0d4b" Jul 09 15:31:50.569294 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:50.569262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" event={"ID":"97b8f217-e61a-4e65-9af1-7a368ccd3567","Type":"ContainerStarted","Data":"ab4774fd32dbefcfc8576bd5f523ff452dfce6ebb9782624a7d988731037e804"} Jul 09 15:31:50.595752 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:50.595684 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pqrhk" podStartSLOduration=8.346571002 podStartE2EDuration="38.595668164s" totalImagesPullingTime="30.249097162s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:50.595487113 +0000 UTC m=+38.883079814" watchObservedRunningTime="2026-07-09 15:31:50.595668164 +0000 UTC m=+38.883260862" Jul 09 15:31:51.384876 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:51.384840 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:51.385121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:51.384838 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:51.385121 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:51.385014 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrps5" podUID="00d86721-e2ea-4598-a3a0-a84b11b71f54" Jul 09 15:31:51.385121 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:51.385053 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wzrgp" podUID="0b51398d-8747-424c-96a7-fa84853cd050" Jul 09 15:31:51.976270 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:51.976242 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-112.ec2.internal" event="NodeReady" Jul 09 15:31:51.976660 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:51.976351 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 15:31:52.011274 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.011236 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds"] Jul 09 15:31:52.042907 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.042859 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.043528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.042749 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-kcbkq"] Jul 09 15:31:52.046500 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.046478 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 15:31:52.046620 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.046596 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 15:31:52.046620 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.046491 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 15:31:52.046762 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.046498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-dp2m8\"" Jul 09 15:31:52.046823 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.046792 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:31:52.058772 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.058741 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5745cb5c85-5rq49"] Jul 09 15:31:52.058906 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.058864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.061218 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.061195 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dc8zn\"" Jul 09 15:31:52.061346 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.061198 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 15:31:52.061472 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.061456 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 15:31:52.061791 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.061774 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:31:52.061881 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.061850 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 15:31:52.067923 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.067905 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 15:31:52.076838 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.076815 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds"] Jul 09 15:31:52.076929 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.076846 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp"] Jul 09 15:31:52.076966 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.076932 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.079450 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.079432 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 15:31:52.079531 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.079455 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 15:31:52.079628 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.079613 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lq2hc\"" Jul 09 15:31:52.079673 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.079631 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 15:31:52.085381 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.085360 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 15:31:52.098133 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.098109 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-t7pqb"] Jul 09 15:31:52.098270 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.098241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.100822 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.100800 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 15:31:52.100822 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.100820 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 15:31:52.101005 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.100890 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-p22sv\"" Jul 09 15:31:52.101005 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.100904 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 15:31:52.101168 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.101151 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:31:52.117047 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.117015 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz"] Jul 09 15:31:52.117183 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.117165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:52.119525 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.119501 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 15:31:52.119968 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.119948 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 15:31:52.120545 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.120521 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mrd67\"" Jul 09 15:31:52.137804 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.137776 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9fsrz"] Jul 09 15:31:52.137936 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.137905 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" Jul 09 15:31:52.138024 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.138003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx4nq\" (UniqueName: \"kubernetes.io/projected/de3d5cb5-ef82-48b2-9120-29b3b0908a97-kube-api-access-xx4nq\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.138068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.138047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de3d5cb5-ef82-48b2-9120-29b3b0908a97-config\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.138114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.138076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/778ef260-1256-44b9-a53d-c9a82135ee78-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.138155 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.138113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/778ef260-1256-44b9-a53d-c9a82135ee78-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.138226 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.138200 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn6rx\" (UniqueName: \"kubernetes.io/projected/778ef260-1256-44b9-a53d-c9a82135ee78-kube-api-access-qn6rx\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.138279 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.138250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de3d5cb5-ef82-48b2-9120-29b3b0908a97-serving-cert\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.138407 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.138307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de3d5cb5-ef82-48b2-9120-29b3b0908a97-trusted-ca\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.140341 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.140320 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:31:52.140570 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.140538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:31:52.140676 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.140662 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8lncw\"" Jul 09 15:31:52.154741 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.154718 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r68gb"] Jul 09 15:31:52.154854 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.154814 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.157199 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.157179 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 15:31:52.157306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.157213 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zcxss\"" Jul 09 15:31:52.157306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.157282 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 15:31:52.170993 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.170970 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5745cb5c85-5rq49"] Jul 09 15:31:52.170993 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.171002 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp"] Jul 09 15:31:52.171200 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.171022 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz"] Jul 09 15:31:52.171200 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.171046 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9fsrz"] Jul 09 15:31:52.171200 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.171069 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-kcbkq"] Jul 09 15:31:52.171200 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.171089 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r68gb"] Jul 09 15:31:52.171200 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.171108 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-t7pqb"] Jul 09 15:31:52.171415 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.171229 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.173754 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.173729 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 15:31:52.173862 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.173774 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wrjlr\"" Jul 09 15:31:52.173862 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.173827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 15:31:52.173971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.173952 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 15:31:52.239160 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239064 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de3d5cb5-ef82-48b2-9120-29b3b0908a97-serving-cert\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.239160 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c177890-f1f5-4008-82ce-49d6ed1cb63f-config\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.239160 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59f60fe0-0d41-4bb1-abb9-7436adeab01e-tmp-dir\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.239160 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239147 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-trusted-ca\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239200 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de3d5cb5-ef82-48b2-9120-29b3b0908a97-trusted-ca\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239252 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx4nq\" (UniqueName: \"kubernetes.io/projected/de3d5cb5-ef82-48b2-9120-29b3b0908a97-kube-api-access-xx4nq\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de3d5cb5-ef82-48b2-9120-29b3b0908a97-config\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/778ef260-1256-44b9-a53d-c9a82135ee78-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239317 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsl48\" (UniqueName: \"kubernetes.io/projected/1c177890-f1f5-4008-82ce-49d6ed1cb63f-kube-api-access-hsl48\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c177890-f1f5-4008-82ce-49d6ed1cb63f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59f60fe0-0d41-4bb1-abb9-7436adeab01e-config-volume\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvgw2\" (UniqueName: \"kubernetes.io/projected/59f60fe0-0d41-4bb1-abb9-7436adeab01e-kube-api-access-hvgw2\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.239473 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-installation-pull-secrets\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.239944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239486 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prtjm\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-kube-api-access-prtjm\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.239944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239579 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/778ef260-1256-44b9-a53d-c9a82135ee78-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.239944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239716 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:52.239944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nr8v\" (UniqueName: \"kubernetes.io/projected/b079cfd2-0c05-448e-84c7-7b9d4ef442db-kube-api-access-6nr8v\") pod \"network-check-source-869dcfcdcd-cxxzz\" (UID: \"b079cfd2-0c05-448e-84c7-7b9d4ef442db\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" Jul 09 15:31:52.239944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239781 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.239944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/494655c0-bdb4-45fc-a4bd-74c75339bd0c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:52.239944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-ca-trust-extracted\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.240275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239949 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.240275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239992 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn6rx\" (UniqueName: \"kubernetes.io/projected/778ef260-1256-44b9-a53d-c9a82135ee78-kube-api-access-qn6rx\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.240275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.239998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/778ef260-1256-44b9-a53d-c9a82135ee78-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.240275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.240004 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de3d5cb5-ef82-48b2-9120-29b3b0908a97-config\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.240275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.240065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-image-registry-private-configuration\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.240275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.240107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-certificates\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.240275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.240144 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-bound-sa-token\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.240512 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.240333 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de3d5cb5-ef82-48b2-9120-29b3b0908a97-trusted-ca\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.244395 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.244374 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/778ef260-1256-44b9-a53d-c9a82135ee78-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.244542 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.244523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de3d5cb5-ef82-48b2-9120-29b3b0908a97-serving-cert\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.249022 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.248993 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn6rx\" (UniqueName: \"kubernetes.io/projected/778ef260-1256-44b9-a53d-c9a82135ee78-kube-api-access-qn6rx\") pod \"kube-storage-version-migrator-operator-799cb7f958-x52ds\" (UID: \"778ef260-1256-44b9-a53d-c9a82135ee78\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.249153 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.249021 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx4nq\" (UniqueName: \"kubernetes.io/projected/de3d5cb5-ef82-48b2-9120-29b3b0908a97-kube-api-access-xx4nq\") pod \"console-operator-7866497494-kcbkq\" (UID: \"de3d5cb5-ef82-48b2-9120-29b3b0908a97\") " pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.341357 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01f3ba4e-b51b-469b-a118-cbbfc543f9c9-cert\") pod \"ingress-canary-r68gb\" (UID: \"01f3ba4e-b51b-469b-a118-cbbfc543f9c9\") " pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.341357 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341363 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nr8v\" (UniqueName: \"kubernetes.io/projected/b079cfd2-0c05-448e-84c7-7b9d4ef442db-kube-api-access-6nr8v\") pod \"network-check-source-869dcfcdcd-cxxzz\" (UID: \"b079cfd2-0c05-448e-84c7-7b9d4ef442db\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-bound-sa-token\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341417 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/494655c0-bdb4-45fc-a4bd-74c75339bd0c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341437 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.341487 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.341502 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.341508 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5745cb5c85-5rq49: secret "image-registry-tls" not found Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.341555 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert podName:494655c0-bdb4-45fc-a4bd-74c75339bd0c nodeName:}" failed. No retries permitted until 2026-07-09 15:31:52.841538792 +0000 UTC m=+41.129131468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-t7pqb" (UID: "494655c0-bdb4-45fc-a4bd-74c75339bd0c") : secret "networking-console-plugin-cert" not found Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvgw2\" (UniqueName: \"kubernetes.io/projected/59f60fe0-0d41-4bb1-abb9-7436adeab01e-kube-api-access-hvgw2\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.341612 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls podName:8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:52.841594957 +0000 UTC m=+41.129187637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls") pod "image-registry-5745cb5c85-5rq49" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1") : secret "image-registry-tls" not found Jul 09 15:31:52.341639 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341645 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-image-registry-private-configuration\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-certificates\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341717 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c177890-f1f5-4008-82ce-49d6ed1cb63f-config\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341737 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59f60fe0-0d41-4bb1-abb9-7436adeab01e-tmp-dir\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-trusted-ca\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341768 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.341793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c177890-f1f5-4008-82ce-49d6ed1cb63f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.341926 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.341982 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls podName:59f60fe0-0d41-4bb1-abb9-7436adeab01e nodeName:}" failed. No retries permitted until 2026-07-09 15:31:52.841967922 +0000 UTC m=+41.129560605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls") pod "dns-default-9fsrz" (UID: "59f60fe0-0d41-4bb1-abb9-7436adeab01e") : secret "dns-default-metrics-tls" not found Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342079 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59f60fe0-0d41-4bb1-abb9-7436adeab01e-tmp-dir\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bnlm\" (UniqueName: \"kubernetes.io/projected/01f3ba4e-b51b-469b-a118-cbbfc543f9c9-kube-api-access-2bnlm\") pod \"ingress-canary-r68gb\" (UID: \"01f3ba4e-b51b-469b-a118-cbbfc543f9c9\") " pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342207 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsl48\" (UniqueName: \"kubernetes.io/projected/1c177890-f1f5-4008-82ce-49d6ed1cb63f-kube-api-access-hsl48\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-installation-pull-secrets\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.342266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prtjm\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-kube-api-access-prtjm\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.342917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342287 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59f60fe0-0d41-4bb1-abb9-7436adeab01e-config-volume\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.342917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342300 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/494655c0-bdb4-45fc-a4bd-74c75339bd0c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:52.342917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-ca-trust-extracted\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.342917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-certificates\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.342917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342612 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1c177890-f1f5-4008-82ce-49d6ed1cb63f-config\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.342917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342849 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-trusted-ca\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.343215 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342948 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/59f60fe0-0d41-4bb1-abb9-7436adeab01e-config-volume\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.343215 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.342959 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-ca-trust-extracted\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.344219 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.344194 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1c177890-f1f5-4008-82ce-49d6ed1cb63f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.344328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.344255 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-image-registry-private-configuration\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.344564 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.344548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-installation-pull-secrets\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.354361 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.354336 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" Jul 09 15:31:52.356535 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.356506 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nr8v\" (UniqueName: \"kubernetes.io/projected/b079cfd2-0c05-448e-84c7-7b9d4ef442db-kube-api-access-6nr8v\") pod \"network-check-source-869dcfcdcd-cxxzz\" (UID: \"b079cfd2-0c05-448e-84c7-7b9d4ef442db\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" Jul 09 15:31:52.356720 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.356678 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-bound-sa-token\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.357002 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.356981 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prtjm\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-kube-api-access-prtjm\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.357435 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.357416 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvgw2\" (UniqueName: \"kubernetes.io/projected/59f60fe0-0d41-4bb1-abb9-7436adeab01e-kube-api-access-hvgw2\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.358339 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.358322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsl48\" (UniqueName: \"kubernetes.io/projected/1c177890-f1f5-4008-82ce-49d6ed1cb63f-kube-api-access-hsl48\") pod \"service-ca-operator-7695fc6c8c-m4scp\" (UID: \"1c177890-f1f5-4008-82ce-49d6ed1cb63f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.368423 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.368402 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:31:52.385792 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.385772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:31:52.388588 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.388565 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:31:52.388699 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.388674 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rsq6f\"" Jul 09 15:31:52.407042 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.407004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" Jul 09 15:31:52.442952 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.442921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bnlm\" (UniqueName: \"kubernetes.io/projected/01f3ba4e-b51b-469b-a118-cbbfc543f9c9-kube-api-access-2bnlm\") pod \"ingress-canary-r68gb\" (UID: \"01f3ba4e-b51b-469b-a118-cbbfc543f9c9\") " pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.443072 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.443002 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01f3ba4e-b51b-469b-a118-cbbfc543f9c9-cert\") pod \"ingress-canary-r68gb\" (UID: \"01f3ba4e-b51b-469b-a118-cbbfc543f9c9\") " pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.446082 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.445642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" Jul 09 15:31:52.446581 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.446565 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/01f3ba4e-b51b-469b-a118-cbbfc543f9c9-cert\") pod \"ingress-canary-r68gb\" (UID: \"01f3ba4e-b51b-469b-a118-cbbfc543f9c9\") " pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.451901 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.451861 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bnlm\" (UniqueName: \"kubernetes.io/projected/01f3ba4e-b51b-469b-a118-cbbfc543f9c9-kube-api-access-2bnlm\") pod \"ingress-canary-r68gb\" (UID: \"01f3ba4e-b51b-469b-a118-cbbfc543f9c9\") " pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.485165 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.480883 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r68gb" Jul 09 15:31:52.586797 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.586523 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds"] Jul 09 15:31:52.607826 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.606934 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp"] Jul 09 15:31:52.607826 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:52.607514 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778ef260_1256_44b9_a53d_c9a82135ee78.slice/crio-dd7288956f398a3e8550d7e95a921dbada7a9cfc108890177aeddfd406178273 WatchSource:0}: Error finding container dd7288956f398a3e8550d7e95a921dbada7a9cfc108890177aeddfd406178273: Status 404 returned error can't find the container with id dd7288956f398a3e8550d7e95a921dbada7a9cfc108890177aeddfd406178273 Jul 09 15:31:52.612926 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.612520 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-kcbkq"] Jul 09 15:31:52.666959 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.666923 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz"] Jul 09 15:31:52.670243 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:52.670213 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb079cfd2_0c05_448e_84c7_7b9d4ef442db.slice/crio-c5bdd326651c6c22c5470fc0c69d5cf3270be178e7c1f976471a1262947cbce9 WatchSource:0}: Error finding container c5bdd326651c6c22c5470fc0c69d5cf3270be178e7c1f976471a1262947cbce9: Status 404 returned error can't find the container with id c5bdd326651c6c22c5470fc0c69d5cf3270be178e7c1f976471a1262947cbce9 Jul 09 15:31:52.684856 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.684826 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r68gb"] Jul 09 15:31:52.689540 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:31:52.689510 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f3ba4e_b51b_469b_a118_cbbfc543f9c9.slice/crio-86623dc3ffba5779b4af076e923a374b64fc79482cbeb9f0864561eb3ef34f53 WatchSource:0}: Error finding container 86623dc3ffba5779b4af076e923a374b64fc79482cbeb9f0864561eb3ef34f53: Status 404 returned error can't find the container with id 86623dc3ffba5779b4af076e923a374b64fc79482cbeb9f0864561eb3ef34f53 Jul 09 15:31:52.848534 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.848496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:52.848735 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.848541 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:52.848735 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.848668 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:31:52.848735 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:52.848680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:52.848844 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.848739 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:31:52.848844 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.848752 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls podName:59f60fe0-0d41-4bb1-abb9-7436adeab01e nodeName:}" failed. No retries permitted until 2026-07-09 15:31:53.848736462 +0000 UTC m=+42.136329137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls") pod "dns-default-9fsrz" (UID: "59f60fe0-0d41-4bb1-abb9-7436adeab01e") : secret "dns-default-metrics-tls" not found Jul 09 15:31:52.848844 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.848666 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:31:52.848844 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.848769 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5745cb5c85-5rq49: secret "image-registry-tls" not found Jul 09 15:31:52.848844 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.848792 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert podName:494655c0-bdb4-45fc-a4bd-74c75339bd0c nodeName:}" failed. No retries permitted until 2026-07-09 15:31:53.848778339 +0000 UTC m=+42.136371014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-t7pqb" (UID: "494655c0-bdb4-45fc-a4bd-74c75339bd0c") : secret "networking-console-plugin-cert" not found Jul 09 15:31:52.848844 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:52.848807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls podName:8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:53.848800906 +0000 UTC m=+42.136393582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls") pod "image-registry-5745cb5c85-5rq49" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1") : secret "image-registry-tls" not found Jul 09 15:31:53.384204 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.384164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:31:53.384733 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.384164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:31:53.387105 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.387084 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:31:53.387400 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.387379 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnkz7\"" Jul 09 15:31:53.578865 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.578829 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kcbkq" event={"ID":"de3d5cb5-ef82-48b2-9120-29b3b0908a97","Type":"ContainerStarted","Data":"141be6d2ff6bf5bda20b6e0ccfd244e3606175b31ff2490f58cd266133abaf41"} Jul 09 15:31:53.580370 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.580309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" event={"ID":"778ef260-1256-44b9-a53d-c9a82135ee78","Type":"ContainerStarted","Data":"dd7288956f398a3e8550d7e95a921dbada7a9cfc108890177aeddfd406178273"} Jul 09 15:31:53.582130 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.582090 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r68gb" event={"ID":"01f3ba4e-b51b-469b-a118-cbbfc543f9c9","Type":"ContainerStarted","Data":"86623dc3ffba5779b4af076e923a374b64fc79482cbeb9f0864561eb3ef34f53"} Jul 09 15:31:53.584007 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.583947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" event={"ID":"1c177890-f1f5-4008-82ce-49d6ed1cb63f","Type":"ContainerStarted","Data":"21316d09f7f682b3dccc18c64cfe3ef4565391125516dd17765cffc2698f8d45"} Jul 09 15:31:53.585489 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.585458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" event={"ID":"b079cfd2-0c05-448e-84c7-7b9d4ef442db","Type":"ContainerStarted","Data":"c5bdd326651c6c22c5470fc0c69d5cf3270be178e7c1f976471a1262947cbce9"} Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.857271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.857335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:53.857392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:53.857590 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:53.857651 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls podName:59f60fe0-0d41-4bb1-abb9-7436adeab01e nodeName:}" failed. No retries permitted until 2026-07-09 15:31:55.857633533 +0000 UTC m=+44.145226213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls") pod "dns-default-9fsrz" (UID: "59f60fe0-0d41-4bb1-abb9-7436adeab01e") : secret "dns-default-metrics-tls" not found Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:53.858067 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:53.858087 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5745cb5c85-5rq49: secret "image-registry-tls" not found Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:53.858135 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls podName:8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:55.858118151 +0000 UTC m=+44.145710833 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls") pod "image-registry-5745cb5c85-5rq49" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1") : secret "image-registry-tls" not found Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:53.858197 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:31:53.858262 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:53.858230 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert podName:494655c0-bdb4-45fc-a4bd-74c75339bd0c nodeName:}" failed. No retries permitted until 2026-07-09 15:31:55.858219897 +0000 UTC m=+44.145812579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-t7pqb" (UID: "494655c0-bdb4-45fc-a4bd-74c75339bd0c") : secret "networking-console-plugin-cert" not found Jul 09 15:31:55.877847 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:55.877808 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:55.877899 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:55.877924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:55.877948 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:55.878029 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls podName:59f60fe0-0d41-4bb1-abb9-7436adeab01e nodeName:}" failed. No retries permitted until 2026-07-09 15:31:59.878007674 +0000 UTC m=+48.165600372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls") pod "dns-default-9fsrz" (UID: "59f60fe0-0d41-4bb1-abb9-7436adeab01e") : secret "dns-default-metrics-tls" not found Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:55.878029 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:55.878041 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:55.878056 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5745cb5c85-5rq49: secret "image-registry-tls" not found Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:55.878070 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert podName:494655c0-bdb4-45fc-a4bd-74c75339bd0c nodeName:}" failed. No retries permitted until 2026-07-09 15:31:59.878060489 +0000 UTC m=+48.165653191 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-t7pqb" (UID: "494655c0-bdb4-45fc-a4bd-74c75339bd0c") : secret "networking-console-plugin-cert" not found Jul 09 15:31:55.878509 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:55.878092 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls podName:8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:59.878080712 +0000 UTC m=+48.165673397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls") pod "image-registry-5745cb5c85-5rq49" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1") : secret "image-registry-tls" not found Jul 09 15:31:58.206317 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:58.206283 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:58.287984 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:58.287941 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:59.604586 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.604043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" event={"ID":"b079cfd2-0c05-448e-84c7-7b9d4ef442db","Type":"ContainerStarted","Data":"fcfa1bedfbfa957c68341a694066373f1afe9059a67b80ee6ab385ef2ef72eff"} Jul 09 15:31:59.605684 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.605659 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/0.log" Jul 09 15:31:59.605840 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.605712 2578 generic.go:356] "Generic (PLEG): container finished" podID="de3d5cb5-ef82-48b2-9120-29b3b0908a97" containerID="4fbdff29285aafaa57e0e9056786aa9a5d2c6dedae0c4cd2f5eb43e879877262" exitCode=255 Jul 09 15:31:59.605840 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.605778 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kcbkq" event={"ID":"de3d5cb5-ef82-48b2-9120-29b3b0908a97","Type":"ContainerDied","Data":"4fbdff29285aafaa57e0e9056786aa9a5d2c6dedae0c4cd2f5eb43e879877262"} Jul 09 15:31:59.606016 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.605997 2578 scope.go:117] "RemoveContainer" containerID="4fbdff29285aafaa57e0e9056786aa9a5d2c6dedae0c4cd2f5eb43e879877262" Jul 09 15:31:59.608579 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.608501 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" event={"ID":"778ef260-1256-44b9-a53d-c9a82135ee78","Type":"ContainerStarted","Data":"5e753ecc0d39e951350763a704b45113e6042bc1666e271048567b17da5a398a"} Jul 09 15:31:59.610424 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.610400 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r68gb" event={"ID":"01f3ba4e-b51b-469b-a118-cbbfc543f9c9","Type":"ContainerStarted","Data":"e08fd2bc2e9de313321ea9096aa75d1d64d8dbebe6e7acccd1fc0db0a117e261"} Jul 09 15:31:59.612083 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.612055 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" event={"ID":"1c177890-f1f5-4008-82ce-49d6ed1cb63f","Type":"ContainerStarted","Data":"7cb6cb01781d652a5b0965f612bd50d5837b283d78e2fb401e622ecc09e948d6"} Jul 09 15:31:59.621682 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.621626 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-cxxzz" podStartSLOduration=36.045024591 podStartE2EDuration="42.62160791s" totalImagesPullingTime="6.576583319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:59.620704045 +0000 UTC m=+47.908296741" watchObservedRunningTime="2026-07-09 15:31:59.62160791 +0000 UTC m=+47.909200609" Jul 09 15:31:59.639640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.639585 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" podStartSLOduration=35.017906303 podStartE2EDuration="41.63956285s" totalImagesPullingTime="6.621656547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:59.638217615 +0000 UTC m=+47.925810315" watchObservedRunningTime="2026-07-09 15:31:59.63956285 +0000 UTC m=+47.927155549" Jul 09 15:31:59.654927 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.654869 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r68gb" podStartSLOduration=1.107077527 podStartE2EDuration="7.654848369s" totalImagesPullingTime="6.547770842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:59.653968054 +0000 UTC m=+47.941560753" watchObservedRunningTime="2026-07-09 15:31:59.654848369 +0000 UTC m=+47.942441070" Jul 09 15:31:59.671455 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.670994 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" podStartSLOduration=37.043606594 podStartE2EDuration="43.6709742s" totalImagesPullingTime="6.627367606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:59.670413327 +0000 UTC m=+47.958006026" watchObservedRunningTime="2026-07-09 15:31:59.6709742 +0000 UTC m=+47.958566899" Jul 09 15:31:59.893119 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.893061 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:59.909626 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.909590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:31:59.909832 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.909680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:31:59.909832 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.909732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:31:59.909832 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:59.909758 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:31:59.909832 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:59.909811 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:31:59.909832 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:59.909829 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls podName:59f60fe0-0d41-4bb1-abb9-7436adeab01e nodeName:}" failed. No retries permitted until 2026-07-09 15:32:07.909809523 +0000 UTC m=+56.197402216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls") pod "dns-default-9fsrz" (UID: "59f60fe0-0d41-4bb1-abb9-7436adeab01e") : secret "dns-default-metrics-tls" not found Jul 09 15:31:59.910092 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:59.909847 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert podName:494655c0-bdb4-45fc-a4bd-74c75339bd0c nodeName:}" failed. No retries permitted until 2026-07-09 15:32:07.9098375 +0000 UTC m=+56.197430189 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-t7pqb" (UID: "494655c0-bdb4-45fc-a4bd-74c75339bd0c") : secret "networking-console-plugin-cert" not found Jul 09 15:31:59.910092 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:59.909848 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:31:59.910092 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:59.909872 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5745cb5c85-5rq49: secret "image-registry-tls" not found Jul 09 15:31:59.910092 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:31:59.909929 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls podName:8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1 nodeName:}" failed. No retries permitted until 2026-07-09 15:32:07.909912076 +0000 UTC m=+56.197504757 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls") pod "image-registry-5745cb5c85-5rq49" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1") : secret "image-registry-tls" not found Jul 09 15:31:59.958419 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:31:59.958362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:00.010078 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.009982 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn"] Jul 09 15:32:00.032991 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.032926 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn"] Jul 09 15:32:00.033170 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.033092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.036126 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.036102 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 15:32:00.036126 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.036112 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 15:32:00.036388 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.036352 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 15:32:00.036492 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.036386 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 15:32:00.036492 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.036443 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 15:32:00.036606 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.036534 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 15:32:00.036606 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.036578 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 15:32:00.111215 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.111159 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.111215 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.111212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz2vw\" (UniqueName: \"kubernetes.io/projected/dd7bcb94-efa5-4020-9404-151731276a65-kube-api-access-kz2vw\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.111458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.111293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-ca\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.111458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.111319 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.111458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.111362 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-hub\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.111458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.111406 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd7bcb94-efa5-4020-9404-151731276a65-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.212520 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.212466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd7bcb94-efa5-4020-9404-151731276a65-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.212676 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.212591 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.212676 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.212622 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz2vw\" (UniqueName: \"kubernetes.io/projected/dd7bcb94-efa5-4020-9404-151731276a65-kube-api-access-kz2vw\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.212811 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.212685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-ca\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.212811 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.212729 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.212811 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.212773 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-hub\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.213339 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.213313 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dd7bcb94-efa5-4020-9404-151731276a65-additional-service-ca\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.217422 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.217393 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-ca\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.217548 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.217503 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-hub\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.217605 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.217506 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.217932 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.217915 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd7bcb94-efa5-4020-9404-151731276a65-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.222866 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.222837 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz2vw\" (UniqueName: \"kubernetes.io/projected/dd7bcb94-efa5-4020-9404-151731276a65-kube-api-access-kz2vw\") pod \"cluster-proxy-proxy-agent-b94b8c97b-zp6nn\" (UID: \"dd7bcb94-efa5-4020-9404-151731276a65\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.352284 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.352250 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:00.546827 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.546800 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn"] Jul 09 15:32:00.590126 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.590093 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:00.618221 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.618189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:32:00.618669 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.618647 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/0.log" Jul 09 15:32:00.618821 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.618707 2578 generic.go:356] "Generic (PLEG): container finished" podID="de3d5cb5-ef82-48b2-9120-29b3b0908a97" containerID="2b7a0a79b411b1803db9ee1f294662554b3726c3716db32ab62c13be7d020bcf" exitCode=255 Jul 09 15:32:00.618821 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.618774 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kcbkq" event={"ID":"de3d5cb5-ef82-48b2-9120-29b3b0908a97","Type":"ContainerDied","Data":"2b7a0a79b411b1803db9ee1f294662554b3726c3716db32ab62c13be7d020bcf"} Jul 09 15:32:00.618929 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.618849 2578 scope.go:117] "RemoveContainer" containerID="4fbdff29285aafaa57e0e9056786aa9a5d2c6dedae0c4cd2f5eb43e879877262" Jul 09 15:32:00.619110 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.619088 2578 scope.go:117] "RemoveContainer" containerID="2b7a0a79b411b1803db9ee1f294662554b3726c3716db32ab62c13be7d020bcf" Jul 09 15:32:00.619312 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:00.619284 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-kcbkq_openshift-console-operator(de3d5cb5-ef82-48b2-9120-29b3b0908a97)\"" pod="openshift-console-operator/console-operator-7866497494-kcbkq" podUID="de3d5cb5-ef82-48b2-9120-29b3b0908a97" Jul 09 15:32:00.620205 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.620183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" event={"ID":"dd7bcb94-efa5-4020-9404-151731276a65","Type":"ContainerStarted","Data":"c40a67e0a42f0a476702605d66cda7eefea752a49f6689b144a038ff5462ecf3"} Jul 09 15:32:00.702766 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.702724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:00.788614 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:00.788581 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:01.347892 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:01.347840 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:01.624787 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:01.624682 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:32:01.625260 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:01.625088 2578 scope.go:117] "RemoveContainer" containerID="2b7a0a79b411b1803db9ee1f294662554b3726c3716db32ab62c13be7d020bcf" Jul 09 15:32:01.625326 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:01.625297 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-kcbkq_openshift-console-operator(de3d5cb5-ef82-48b2-9120-29b3b0908a97)\"" pod="openshift-console-operator/console-operator-7866497494-kcbkq" podUID="de3d5cb5-ef82-48b2-9120-29b3b0908a97" Jul 09 15:32:01.720128 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:01.720098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:02.369274 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:02.369231 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:32:02.369447 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:02.369327 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:32:02.628038 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:02.627961 2578 scope.go:117] "RemoveContainer" containerID="2b7a0a79b411b1803db9ee1f294662554b3726c3716db32ab62c13be7d020bcf" Jul 09 15:32:02.628387 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:02.628121 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-kcbkq_openshift-console-operator(de3d5cb5-ef82-48b2-9120-29b3b0908a97)\"" pod="openshift-console-operator/console-operator-7866497494-kcbkq" podUID="de3d5cb5-ef82-48b2-9120-29b3b0908a97" Jul 09 15:32:04.736259 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:04.736220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:04.791522 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:04.791492 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:05.153375 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:05.153337 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:05.253495 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:05.253465 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:07.511779 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:07.511742 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:07.613108 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:07.613074 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:07.971305 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:07.971267 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:32:07.971503 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:07.971330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:32:07.971503 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:07.971410 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:32:07.971835 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:07.971386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:32:07.971949 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:07.971856 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5745cb5c85-5rq49: secret "image-registry-tls" not found Jul 09 15:32:07.971949 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:07.971879 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:32:07.971949 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:07.971925 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:32:07.972098 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:07.972000 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert podName:494655c0-bdb4-45fc-a4bd-74c75339bd0c nodeName:}" failed. No retries permitted until 2026-07-09 15:32:23.971977046 +0000 UTC m=+72.259569741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-t7pqb" (UID: "494655c0-bdb4-45fc-a4bd-74c75339bd0c") : secret "networking-console-plugin-cert" not found Jul 09 15:32:07.972245 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:07.972173 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls podName:8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1 nodeName:}" failed. No retries permitted until 2026-07-09 15:32:23.97213912 +0000 UTC m=+72.259731815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls") pod "image-registry-5745cb5c85-5rq49" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1") : secret "image-registry-tls" not found Jul 09 15:32:07.972245 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:07.972205 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls podName:59f60fe0-0d41-4bb1-abb9-7436adeab01e nodeName:}" failed. No retries permitted until 2026-07-09 15:32:23.972191524 +0000 UTC m=+72.259784212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls") pod "dns-default-9fsrz" (UID: "59f60fe0-0d41-4bb1-abb9-7436adeab01e") : secret "dns-default-metrics-tls" not found Jul 09 15:32:08.254932 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.254847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:08.417503 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.417040 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:08.533500 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.533411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:08.634982 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.634950 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:08.650204 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.650164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" event={"ID":"dd7bcb94-efa5-4020-9404-151731276a65","Type":"ContainerStarted","Data":"c54ae31609aaee4c4a3685e2af5bd6beee24b087f82d2ff49ebc49935fa5a53f"} Jul 09 15:32:08.650204 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.650210 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" event={"ID":"dd7bcb94-efa5-4020-9404-151731276a65","Type":"ContainerStarted","Data":"36179cd4fea8d4c03bc56515fac06f750f550e76854ffd40ab9500a6a3967c9b"} Jul 09 15:32:08.650430 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.650224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" event={"ID":"dd7bcb94-efa5-4020-9404-151731276a65","Type":"ContainerStarted","Data":"a118088fd82ff323c3894b2638f16bf08e480982825815531947fb6a74689084"} Jul 09 15:32:08.677413 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.677360 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" podStartSLOduration=1.922555303 podStartE2EDuration="9.677343637s" totalImagesPullingTime="7.754788334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:08.67607899 +0000 UTC m=+56.963671701" watchObservedRunningTime="2026-07-09 15:32:08.677343637 +0000 UTC m=+56.964936334" Jul 09 15:32:08.703657 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.703616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:08.763566 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.763525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:08.986763 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:08.986724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:09.882628 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:09.882569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:10.158217 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:10.158128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:10.355241 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:10.355193 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" podUID="dd7bcb94-efa5-4020-9404-151731276a65" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 15:32:10.355578 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:10.355556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:10.554432 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:10.554398 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:13.893881 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:13.893837 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:13.997755 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:13.997715 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:14.155463 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:14.155357 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:14.558228 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:14.558184 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:14.668474 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:14.668431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:14.947442 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:14.947359 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:15.047521 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.047485 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:15.359416 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.359377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:15.384677 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.384652 2578 scope.go:117] "RemoveContainer" containerID="2b7a0a79b411b1803db9ee1f294662554b3726c3716db32ab62c13be7d020bcf" Jul 09 15:32:15.674096 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.674011 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:32:15.674272 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.674103 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-kcbkq" event={"ID":"de3d5cb5-ef82-48b2-9120-29b3b0908a97","Type":"ContainerStarted","Data":"e9447bf3657151681e7a711a77e0542bb739982f1cbf4f37b441bdfa7266a889"} Jul 09 15:32:15.674429 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.674404 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:32:15.694938 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.694880 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-kcbkq" podStartSLOduration=57.078673538 podStartE2EDuration="1m3.694860996s" totalImagesPullingTime="6.616187458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:15.694604267 +0000 UTC m=+63.982196973" watchObservedRunningTime="2026-07-09 15:32:15.694860996 +0000 UTC m=+63.982453693" Jul 09 15:32:15.788559 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:15.788486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:16.021227 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:16.021152 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-kcbkq" Jul 09 15:32:16.183802 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:16.183746 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:16.283000 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:16.282914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:16.561258 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:16.561232 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w7hnj" Jul 09 15:32:17.039262 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.039178 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.102339 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.102309 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.314266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.314215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.414453 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.414413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.519678 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.519608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.618763 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.618653 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.733663 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.733617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.835852 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.835815 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.935556 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.935468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.961654 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.961616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:32:17.961807 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.961748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:32:17.964921 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.964891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:32:17.964921 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.964922 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:32:17.974339 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.974305 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c857fbaa-1128-476e-8881-e59a3c6e0d4b-metrics-certs\") pod \"network-metrics-daemon-5xkpt\" (UID: \"c857fbaa-1128-476e-8881-e59a3c6e0d4b\") " pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:32:17.974339 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.974331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/00d86721-e2ea-4598-a3a0-a84b11b71f54-original-pull-secret\") pod \"global-pull-secret-syncer-vrps5\" (UID: \"00d86721-e2ea-4598-a3a0-a84b11b71f54\") " pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:32:17.991255 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.991228 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.997148 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:17.997127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrps5" Jul 09 15:32:18.063073 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.063036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:32:18.065620 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.065595 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c98l6\" (UniqueName: \"kubernetes.io/projected/0b51398d-8747-424c-96a7-fa84853cd050-kube-api-access-c98l6\") pod \"network-check-target-wzrgp\" (UID: \"0b51398d-8747-424c-96a7-fa84853cd050\") " pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:32:18.098216 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.098179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:18.132480 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.132451 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrps5"] Jul 09 15:32:18.136448 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:32:18.136417 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d86721_e2ea_4598_a3a0_a84b11b71f54.slice/crio-78ad943339a812070dfe3a8bfe24493f277e7c80636464881124a926d46902d3 WatchSource:0}: Error finding container 78ad943339a812070dfe3a8bfe24493f277e7c80636464881124a926d46902d3: Status 404 returned error can't find the container with id 78ad943339a812070dfe3a8bfe24493f277e7c80636464881124a926d46902d3 Jul 09 15:32:18.200359 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.200275 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rsq6f\"" Jul 09 15:32:18.207637 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.207616 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5xkpt" Jul 09 15:32:18.307613 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.307585 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bnkz7\"" Jul 09 15:32:18.315226 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.315194 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:32:18.341394 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.341370 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5xkpt"] Jul 09 15:32:18.343170 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:32:18.343144 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc857fbaa_1128_476e_8881_e59a3c6e0d4b.slice/crio-f447cc1fba964cfde631940fd49b5a577ab260f577e39dbca9fe5ed671879aed WatchSource:0}: Error finding container f447cc1fba964cfde631940fd49b5a577ab260f577e39dbca9fe5ed671879aed: Status 404 returned error can't find the container with id f447cc1fba964cfde631940fd49b5a577ab260f577e39dbca9fe5ed671879aed Jul 09 15:32:18.365283 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.365249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:18.446647 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.446614 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wzrgp"] Jul 09 15:32:18.449989 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:32:18.449956 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b51398d_8747_424c_96a7_fa84853cd050.slice/crio-bddf8a67ed6339da57cee7e62329c3248426280a778fe5feaefee04e0a544377 WatchSource:0}: Error finding container bddf8a67ed6339da57cee7e62329c3248426280a778fe5feaefee04e0a544377: Status 404 returned error can't find the container with id bddf8a67ed6339da57cee7e62329c3248426280a778fe5feaefee04e0a544377 Jul 09 15:32:18.629707 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.629665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:18.688392 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.688351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrps5" event={"ID":"00d86721-e2ea-4598-a3a0-a84b11b71f54","Type":"ContainerStarted","Data":"78ad943339a812070dfe3a8bfe24493f277e7c80636464881124a926d46902d3"} Jul 09 15:32:18.689802 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.689773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzrgp" event={"ID":"0b51398d-8747-424c-96a7-fa84853cd050","Type":"ContainerStarted","Data":"f97d376b174fd2af9dbc9ec6504af1fd76236b90ba45b8e1547c07c4144ab23d"} Jul 09 15:32:18.689941 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.689823 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wzrgp" event={"ID":"0b51398d-8747-424c-96a7-fa84853cd050","Type":"ContainerStarted","Data":"bddf8a67ed6339da57cee7e62329c3248426280a778fe5feaefee04e0a544377"} Jul 09 15:32:18.690012 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.689960 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:32:18.691034 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.691012 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xkpt" event={"ID":"c857fbaa-1128-476e-8881-e59a3c6e0d4b","Type":"ContainerStarted","Data":"f447cc1fba964cfde631940fd49b5a577ab260f577e39dbca9fe5ed671879aed"} Jul 09 15:32:18.709146 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.709019 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wzrgp" podStartSLOduration=66.70900131 podStartE2EDuration="1m6.70900131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:18.708025991 +0000 UTC m=+66.995618704" watchObservedRunningTime="2026-07-09 15:32:18.70900131 +0000 UTC m=+66.996594009" Jul 09 15:32:18.958263 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:18.958223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:19.524986 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:19.524933 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:19.582126 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:19.582084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:20.354584 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:20.354529 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" podUID="dd7bcb94-efa5-4020-9404-151731276a65" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 15:32:20.699370 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:20.699286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xkpt" event={"ID":"c857fbaa-1128-476e-8881-e59a3c6e0d4b","Type":"ContainerStarted","Data":"cd2c245d134239b1488b3993e2f18a3449e97e596ea87fbb3bd76b5858238fef"} Jul 09 15:32:20.699370 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:20.699354 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5xkpt" event={"ID":"c857fbaa-1128-476e-8881-e59a3c6e0d4b","Type":"ContainerStarted","Data":"04dc1d073b0b858ffc96090f9867ca37f8ab0116d4cbb54a0eb9a62d29f9fba4"} Jul 09 15:32:20.719133 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:20.719077 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5xkpt" podStartSLOduration=67.100338938 podStartE2EDuration="1m8.719058294s" totalImagesPullingTime="1.618719356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:20.718109892 +0000 UTC m=+69.005702592" watchObservedRunningTime="2026-07-09 15:32:20.719058294 +0000 UTC m=+69.006651003" Jul 09 15:32:24.012125 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.012079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:32:24.012553 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.012145 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:32:24.012553 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.012169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:32:24.014584 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.014548 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/59f60fe0-0d41-4bb1-abb9-7436adeab01e-metrics-tls\") pod \"dns-default-9fsrz\" (UID: \"59f60fe0-0d41-4bb1-abb9-7436adeab01e\") " pod="openshift-dns/dns-default-9fsrz" Jul 09 15:32:24.014741 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.014607 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/494655c0-bdb4-45fc-a4bd-74c75339bd0c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-t7pqb\" (UID: \"494655c0-bdb4-45fc-a4bd-74c75339bd0c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:32:24.014741 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.014679 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"image-registry-5745cb5c85-5rq49\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:32:24.189521 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.189434 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lq2hc\"" Jul 09 15:32:24.197270 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.197244 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:32:24.230415 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.230381 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mrd67\"" Jul 09 15:32:24.238034 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.238003 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" Jul 09 15:32:24.265439 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.265401 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zcxss\"" Jul 09 15:32:24.276507 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.276474 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9fsrz" Jul 09 15:32:24.347415 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.347242 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5745cb5c85-5rq49"] Jul 09 15:32:24.352609 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:32:24.352574 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8feb5e3e_dbc3_4916_9d63_ec2ae84cbcc1.slice/crio-91025fdfeb223d56e63745b6ce3339ccbf03165a4171c5e43d244c1e16e8afff WatchSource:0}: Error finding container 91025fdfeb223d56e63745b6ce3339ccbf03165a4171c5e43d244c1e16e8afff: Status 404 returned error can't find the container with id 91025fdfeb223d56e63745b6ce3339ccbf03165a4171c5e43d244c1e16e8afff Jul 09 15:32:24.400051 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.399900 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-t7pqb"] Jul 09 15:32:24.407732 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:32:24.407677 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494655c0_bdb4_45fc_a4bd_74c75339bd0c.slice/crio-ecaf7e067ac0e57a5346d50c40fd94f323e756f873b8620b002f5868a952d18e WatchSource:0}: Error finding container ecaf7e067ac0e57a5346d50c40fd94f323e756f873b8620b002f5868a952d18e: Status 404 returned error can't find the container with id ecaf7e067ac0e57a5346d50c40fd94f323e756f873b8620b002f5868a952d18e Jul 09 15:32:24.430851 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.430824 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9fsrz"] Jul 09 15:32:24.433786 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:32:24.433761 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f60fe0_0d41_4bb1_abb9_7436adeab01e.slice/crio-e75d0f687a9b4107a3bb6f89c37e4bf435d87b05ef4fc8906ae8a79080b5b1a3 WatchSource:0}: Error finding container e75d0f687a9b4107a3bb6f89c37e4bf435d87b05ef4fc8906ae8a79080b5b1a3: Status 404 returned error can't find the container with id e75d0f687a9b4107a3bb6f89c37e4bf435d87b05ef4fc8906ae8a79080b5b1a3 Jul 09 15:32:24.715518 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.715480 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" event={"ID":"494655c0-bdb4-45fc-a4bd-74c75339bd0c","Type":"ContainerStarted","Data":"ecaf7e067ac0e57a5346d50c40fd94f323e756f873b8620b002f5868a952d18e"} Jul 09 15:32:24.717019 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.716988 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" event={"ID":"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1","Type":"ContainerStarted","Data":"11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a"} Jul 09 15:32:24.717164 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.717042 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" event={"ID":"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1","Type":"ContainerStarted","Data":"91025fdfeb223d56e63745b6ce3339ccbf03165a4171c5e43d244c1e16e8afff"} Jul 09 15:32:24.717164 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.717087 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:32:24.718493 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.718471 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrps5" event={"ID":"00d86721-e2ea-4598-a3a0-a84b11b71f54","Type":"ContainerStarted","Data":"87f683a3114f0f3267689fd46d85992c96a8c5bace3e3aef5f9f07852ece1196"} Jul 09 15:32:24.719711 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.719679 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9fsrz" event={"ID":"59f60fe0-0d41-4bb1-abb9-7436adeab01e","Type":"ContainerStarted","Data":"e75d0f687a9b4107a3bb6f89c37e4bf435d87b05ef4fc8906ae8a79080b5b1a3"} Jul 09 15:32:24.753430 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.753378 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" podStartSLOduration=72.753360266 podStartE2EDuration="1m12.753360266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:24.751905281 +0000 UTC m=+73.039497982" watchObservedRunningTime="2026-07-09 15:32:24.753360266 +0000 UTC m=+73.040953008" Jul 09 15:32:24.772118 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:24.772068 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vrps5" podStartSLOduration=67.05506028 podStartE2EDuration="1m12.772052161s" totalImagesPullingTime="5.716991881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:24.771338473 +0000 UTC m=+73.058931172" watchObservedRunningTime="2026-07-09 15:32:24.772052161 +0000 UTC m=+73.059644859" Jul 09 15:32:26.728076 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.728034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" event={"ID":"494655c0-bdb4-45fc-a4bd-74c75339bd0c","Type":"ContainerStarted","Data":"12a2f7dfb651bacf361e23012138499efa84e84517ded039b5ec5e58166faf5a"} Jul 09 15:32:26.729799 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.729775 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9fsrz" event={"ID":"59f60fe0-0d41-4bb1-abb9-7436adeab01e","Type":"ContainerStarted","Data":"8be7445bb680be71b4fd82107ca1ff8252056bdb506fab170925990e8eb58f58"} Jul 09 15:32:26.729923 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.729818 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9fsrz" event={"ID":"59f60fe0-0d41-4bb1-abb9-7436adeab01e","Type":"ContainerStarted","Data":"43c3d0396a4eb108aef4d063c0144eb7bae2f5a8ed6a368afa593a24cf1783e4"} Jul 09 15:32:26.729965 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.729933 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9fsrz" Jul 09 15:32:26.747162 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.747108 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-t7pqb" podStartSLOduration=40.591816528 podStartE2EDuration="42.747088396s" totalImagesPullingTime="2.155271868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:26.746337493 +0000 UTC m=+75.033930181" watchObservedRunningTime="2026-07-09 15:32:26.747088396 +0000 UTC m=+75.034681094" Jul 09 15:32:26.767717 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.767609 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9fsrz" podStartSLOduration=32.688705142 podStartE2EDuration="34.767589127s" totalImagesPullingTime="2.078883985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:26.766024305 +0000 UTC m=+75.053617002" watchObservedRunningTime="2026-07-09 15:32:26.767589127 +0000 UTC m=+75.055181826" Jul 09 15:32:26.918027 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.917989 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:26.970917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:26.970882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:27.974222 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:27.974183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:28.070234 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:28.070201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:28.165728 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:28.165670 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:28.265871 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:28.265785 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:28.875136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:28.875103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:28.932224 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:28.932195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:28.988123 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:28.988090 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:29.289420 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:29.289330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:29.385520 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:29.385491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:29.938650 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:29.938617 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:30.353785 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:30.353747 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" podUID="dd7bcb94-efa5-4020-9404-151731276a65" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 09 15:32:30.354149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:30.353817 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" Jul 09 15:32:30.354321 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:30.354290 2578 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c54ae31609aaee4c4a3685e2af5bd6beee24b087f82d2ff49ebc49935fa5a53f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 09 15:32:30.354383 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:30.354342 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" podUID="dd7bcb94-efa5-4020-9404-151731276a65" containerName="service-proxy" containerID="cri-o://c54ae31609aaee4c4a3685e2af5bd6beee24b087f82d2ff49ebc49935fa5a53f" gracePeriod=30 Jul 09 15:32:30.746753 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:30.746653 2578 generic.go:356] "Generic (PLEG): container finished" podID="dd7bcb94-efa5-4020-9404-151731276a65" containerID="c54ae31609aaee4c4a3685e2af5bd6beee24b087f82d2ff49ebc49935fa5a53f" exitCode=2 Jul 09 15:32:30.746753 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:30.746722 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" event={"ID":"dd7bcb94-efa5-4020-9404-151731276a65","Type":"ContainerDied","Data":"c54ae31609aaee4c4a3685e2af5bd6beee24b087f82d2ff49ebc49935fa5a53f"} Jul 09 15:32:30.746922 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:30.746766 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-b94b8c97b-zp6nn" event={"ID":"dd7bcb94-efa5-4020-9404-151731276a65","Type":"ContainerStarted","Data":"dc5988565efe792c17efc9506ffe7c3585e762dd1ad419c5272512324526bdda"} Jul 09 15:32:31.121733 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:31.121672 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:31.222672 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:31.222638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:31.585372 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:31.585328 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:31.680787 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:31.680754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:32.992923 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:32.992891 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mkhww"] Jul 09 15:32:33.008233 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.008199 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mkhww"] Jul 09 15:32:33.008415 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.008322 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.010947 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.010919 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 15:32:33.010947 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.010954 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 15:32:33.012215 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.012190 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 15:32:33.012324 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.012192 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9q7c\"" Jul 09 15:32:33.012324 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.012200 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 15:32:33.034255 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.034218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:33.085604 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.085564 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92p98\" (UniqueName: \"kubernetes.io/projected/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-api-access-92p98\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.085604 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.085613 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-crio-socket\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.085842 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.085639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.085842 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.085746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.085842 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.085792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-data-volume\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.187071 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.187022 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92p98\" (UniqueName: \"kubernetes.io/projected/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-api-access-92p98\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.187271 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.187107 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-crio-socket\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.187271 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.187129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.187271 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.187163 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.187271 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.187235 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:32:33.187271 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.187261 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:32:33.187528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.187288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-data-volume\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.187528 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.187301 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:33.68728095 +0000 UTC m=+81.974873630 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : configmap "kube-rbac-proxy" not found Jul 09 15:32:33.187528 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.187325 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:33.687314083 +0000 UTC m=+81.974906772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : secret "insights-runtime-extractor-tls" not found Jul 09 15:32:33.187528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.187328 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-crio-socket\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.187743 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.187561 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-data-volume\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.197523 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.197496 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92p98\" (UniqueName: \"kubernetes.io/projected/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-api-access-92p98\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.691076 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.690916 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.691076 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:33.690981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:33.691076 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.691062 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:32:33.691321 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.691073 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:32:33.691321 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.691143 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:34.691124407 +0000 UTC m=+82.978717083 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : configmap "kube-rbac-proxy" not found Jul 09 15:32:33.691321 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:33.691163 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:34.691155284 +0000 UTC m=+82.978747961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : secret "insights-runtime-extractor-tls" not found Jul 09 15:32:34.698458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:34.698413 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:34.698458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:34.698466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:34.699016 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:34.698572 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:32:34.699016 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:34.698576 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:32:34.699016 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:34.698631 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:36.698617705 +0000 UTC m=+84.986210382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : configmap "kube-rbac-proxy" not found Jul 09 15:32:34.699016 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:34.698651 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:36.698636554 +0000 UTC m=+84.986229234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : secret "insights-runtime-extractor-tls" not found Jul 09 15:32:34.790829 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:34.790795 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-t7pqb_494655c0-bdb4-45fc-a4bd-74c75339bd0c/networking-console-plugin/0.log" Jul 09 15:32:34.991968 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:34.991892 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:32:35.190544 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:35.190500 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/2.log" Jul 09 15:32:35.789988 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:35.789958 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9fsrz_59f60fe0-0d41-4bb1-abb9-7436adeab01e/dns/0.log" Jul 09 15:32:35.990325 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:35.990295 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9fsrz_59f60fe0-0d41-4bb1-abb9-7436adeab01e/kube-rbac-proxy/0.log" Jul 09 15:32:36.107273 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:36.107237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:36.209595 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:36.209554 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:36.713350 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:36.713297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:36.713350 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:36.713359 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:36.713623 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:36.713429 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:32:36.713623 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:36.713471 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:32:36.713623 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:36.713496 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:40.71348186 +0000 UTC m=+89.001074536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : configmap "kube-rbac-proxy" not found Jul 09 15:32:36.713623 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:36.713539 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:40.713522497 +0000 UTC m=+89.001115182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : secret "insights-runtime-extractor-tls" not found Jul 09 15:32:36.735842 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:36.735812 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9fsrz" Jul 09 15:32:36.909475 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:36.909433 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:37.005636 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:37.005535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:37.386626 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:37.386597 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rphtv_83e27e52-cff5-4bc7-bb69-ad9404382a80/dns-node-resolver/0.log" Jul 09 15:32:37.586395 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:37.586365 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5745cb5c85-5rq49_8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1/registry/0.log" Jul 09 15:32:38.392137 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:38.392114 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g6kp4_158590de-96c7-40e6-bde3-a5e115670c8d/node-ca/0.log" Jul 09 15:32:39.389928 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:39.389857 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r68gb_01f3ba4e-b51b-469b-a118-cbbfc543f9c9/serve-healthcheck-canary/0.log" Jul 09 15:32:40.657871 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:40.657835 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:40.748464 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:40.748419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:40.748645 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:40.748476 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:40.748645 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:40.748596 2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:32:40.748758 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:40.748658 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:48.748643727 +0000 UTC m=+97.036236402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : configmap "kube-rbac-proxy" not found Jul 09 15:32:40.748758 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:40.748596 2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:32:40.748758 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:32:40.748749 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls podName:b58a6bf7-f7f0-43e0-b9ed-66774c77a97f nodeName:}" failed. No retries permitted until 2026-07-09 15:32:48.748736298 +0000 UTC m=+97.036328987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mkhww" (UID: "b58a6bf7-f7f0-43e0-b9ed-66774c77a97f") : secret "insights-runtime-extractor-tls" not found Jul 09 15:32:45.727398 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:45.727367 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:32:46.708095 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:46.708056 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:46.805123 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:46.805079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:48.810502 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:48.810472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:48.810870 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:48.810514 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:48.810997 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:48.810972 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:48.812745 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:48.812724 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b58a6bf7-f7f0-43e0-b9ed-66774c77a97f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mkhww\" (UID: \"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f\") " pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:48.918731 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:48.918671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mkhww" Jul 09 15:32:49.053294 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:49.053257 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mkhww"] Jul 09 15:32:49.056563 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:32:49.056528 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58a6bf7_f7f0_43e0_b9ed_66774c77a97f.slice/crio-daae736ee8a14845463e1f3785ea5672d5fabb2b3f9f5ef0ecafded90345dcef WatchSource:0}: Error finding container daae736ee8a14845463e1f3785ea5672d5fabb2b3f9f5ef0ecafded90345dcef: Status 404 returned error can't find the container with id daae736ee8a14845463e1f3785ea5672d5fabb2b3f9f5ef0ecafded90345dcef Jul 09 15:32:49.696721 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:49.696601 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wzrgp" Jul 09 15:32:49.814225 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:49.814132 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkhww" event={"ID":"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f","Type":"ContainerStarted","Data":"daae736ee8a14845463e1f3785ea5672d5fabb2b3f9f5ef0ecafded90345dcef"} Jul 09 15:32:50.203049 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:50.203017 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:50.384561 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:50.384521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:50.520028 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:50.519951 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5745cb5c85-5rq49"] Jul 09 15:32:50.599225 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:50.599188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:50.699299 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:50.699257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:50.799529 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:50.799489 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:50.899746 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:50.899709 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:53.830839 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:53.830799 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkhww" event={"ID":"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f","Type":"ContainerStarted","Data":"21777d4c60fe5ca4ac32dcb82bcbea1b7fe012ecf9c9bac24edc2cd0e19d37d1"} Jul 09 15:32:54.835630 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:54.835591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkhww" event={"ID":"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f","Type":"ContainerStarted","Data":"846b07e70a7e2390720be33ddbdf59c2774e7923c6a85b2dd5a04b5cdf306af9"} Jul 09 15:32:59.426372 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:59.426303 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:59.496136 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:59.496098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:59.958657 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:32:59.958618 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:00.053858 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:00.053819 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:00.153505 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:00.153471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:00.260907 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:00.260824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:01.862513 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:01.862427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mkhww" event={"ID":"b58a6bf7-f7f0-43e0-b9ed-66774c77a97f","Type":"ContainerStarted","Data":"ecfd5de834814dd94b17a59182e051f3742ab47c90fe09516457b0fdf5ef9dc9"} Jul 09 15:33:01.883362 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:01.883313 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mkhww" podStartSLOduration=17.511667539 podStartE2EDuration="29.883297603s" totalImagesPullingTime="12.371630064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:32:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:33:01.881664812 +0000 UTC m=+110.169257511" watchObservedRunningTime="2026-07-09 15:33:01.883297603 +0000 UTC m=+110.170890301" Jul 09 15:33:02.378609 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:02.378575 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:03.597365 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:03.597333 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:03.874458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:03.874368 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:03.967179 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:03.967137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:04.007759 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.007726 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zcngb"] Jul 09 15:33:04.009930 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.009909 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.015353 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.015332 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 15:33:04.015484 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.015445 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tffth\"" Jul 09 15:33:04.015484 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.015476 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 15:33:04.016656 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.016228 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 15:33:04.016656 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.016489 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 15:33:04.025312 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.025285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 15:33:04.025469 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.025448 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 15:33:04.030844 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.030824 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-sys\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.030933 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.030851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-wtmp\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.030933 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.030870 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/192155bb-0765-4f28-9887-3a654e8cc426-metrics-client-ca\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.030933 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.030885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrxbr\" (UniqueName: \"kubernetes.io/projected/192155bb-0765-4f28-9887-3a654e8cc426-kube-api-access-zrxbr\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.031037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.030939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-textfile\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.031037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.030978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.031037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.031004 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.031037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.031029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-tls\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.031166 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.031101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-root\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.047269 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.047227 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:04.132086 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.131974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-root\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132086 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-sys\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132086 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132044 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-wtmp\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132086 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132062 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/192155bb-0765-4f28-9887-3a654e8cc426-metrics-client-ca\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132086 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132081 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrxbr\" (UniqueName: \"kubernetes.io/projected/192155bb-0765-4f28-9887-3a654e8cc426-kube-api-access-zrxbr\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132107 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-sys\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-textfile\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132109 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-root\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132166 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132195 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-wtmp\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-tls\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132451 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-textfile\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132827 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132752 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/192155bb-0765-4f28-9887-3a654e8cc426-metrics-client-ca\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.132827 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.132811 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-accelerators-collector-config\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.134593 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.134566 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.134593 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.134589 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/192155bb-0765-4f28-9887-3a654e8cc426-node-exporter-tls\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.145838 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.145811 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrxbr\" (UniqueName: \"kubernetes.io/projected/192155bb-0765-4f28-9887-3a654e8cc426-kube-api-access-zrxbr\") pod \"node-exporter-zcngb\" (UID: \"192155bb-0765-4f28-9887-3a654e8cc426\") " pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.189117 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.189075 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:04.318546 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.318507 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zcngb" Jul 09 15:33:04.328136 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:33:04.328108 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192155bb_0765_4f28_9887_3a654e8cc426.slice/crio-4022cd7fb1063341c1a8f3e6b4f329fa015a1f1d1a74c1887921236647dbdda7 WatchSource:0}: Error finding container 4022cd7fb1063341c1a8f3e6b4f329fa015a1f1d1a74c1887921236647dbdda7: Status 404 returned error can't find the container with id 4022cd7fb1063341c1a8f3e6b4f329fa015a1f1d1a74c1887921236647dbdda7 Jul 09 15:33:04.447613 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.447522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:04.667645 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.667608 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:04.873192 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:04.873153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcngb" event={"ID":"192155bb-0765-4f28-9887-3a654e8cc426","Type":"ContainerStarted","Data":"4022cd7fb1063341c1a8f3e6b4f329fa015a1f1d1a74c1887921236647dbdda7"} Jul 09 15:33:05.028719 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.028671 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:05.141723 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.141624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:05.213905 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.213870 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:05.299579 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.299545 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:05.378008 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.377973 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:05.504174 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.504087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:05.880737 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.880675 2578 generic.go:356] "Generic (PLEG): container finished" podID="192155bb-0765-4f28-9887-3a654e8cc426" containerID="ba7345633a930e1481fc62e9efbf199f5b0a4a37a3d198ff250a9946321fb25a" exitCode=0 Jul 09 15:33:05.881133 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:05.880769 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcngb" event={"ID":"192155bb-0765-4f28-9887-3a654e8cc426","Type":"ContainerDied","Data":"ba7345633a930e1481fc62e9efbf199f5b0a4a37a3d198ff250a9946321fb25a"} Jul 09 15:33:06.886651 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:06.886613 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcngb" event={"ID":"192155bb-0765-4f28-9887-3a654e8cc426","Type":"ContainerStarted","Data":"3623e47c61ea10fd440da6b14b8ef144cd74e6e372342776d3cd65ba3d52da3d"} Jul 09 15:33:06.887045 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:06.886721 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zcngb" event={"ID":"192155bb-0765-4f28-9887-3a654e8cc426","Type":"ContainerStarted","Data":"924a0e3d217bea37a28bcecaae8d63b3776678392de55444630eda92fadd97a7"} Jul 09 15:33:06.935266 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:06.935203 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zcngb" podStartSLOduration=2.582997974 podStartE2EDuration="3.935185468s" totalImagesPullingTime="1.285706903s" totalInitContainerRuntime="66.480591ms" isStatefulPod=true podCreationTimestamp="2026-07-09 15:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:33:06.933939378 +0000 UTC m=+115.221532089" watchObservedRunningTime="2026-07-09 15:33:06.935185468 +0000 UTC m=+115.222778166" Jul 09 15:33:09.995779 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:09.995743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:10.096094 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:10.096042 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:10.334170 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:10.334130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:15.546246 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.546196 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" podUID="8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" containerName="registry" containerID="cri-o://11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a" gracePeriod=30 Jul 09 15:33:15.785073 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.785045 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:33:15.822841 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.822806 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prtjm\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-kube-api-access-prtjm\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.822869 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.822899 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-trusted-ca\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.822959 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-bound-sa-token\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.822987 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-ca-trust-extracted\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.823020 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-certificates\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823273 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.823053 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-installation-pull-secrets\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823273 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.823082 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-image-registry-private-configuration\") pod \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\" (UID: \"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1\") " Jul 09 15:33:15.823538 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.823484 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:15.823685 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.823638 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:15.825811 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.825776 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:33:15.825926 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.825852 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:33:15.825926 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.825899 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-kube-api-access-prtjm" (OuterVolumeSpecName: "kube-api-access-prtjm") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "kube-api-access-prtjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:33:15.826035 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.825922 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:33:15.826035 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.825988 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:33:15.832265 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.832238 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" (UID: "8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:33:15.857484 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.857454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:15.912369 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.912318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:15.917336 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.917307 2578 generic.go:356] "Generic (PLEG): container finished" podID="778ef260-1256-44b9-a53d-c9a82135ee78" containerID="5e753ecc0d39e951350763a704b45113e6042bc1666e271048567b17da5a398a" exitCode=0 Jul 09 15:33:15.917487 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.917384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" event={"ID":"778ef260-1256-44b9-a53d-c9a82135ee78","Type":"ContainerDied","Data":"5e753ecc0d39e951350763a704b45113e6042bc1666e271048567b17da5a398a"} Jul 09 15:33:15.917763 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.917743 2578 scope.go:117] "RemoveContainer" containerID="5e753ecc0d39e951350763a704b45113e6042bc1666e271048567b17da5a398a" Jul 09 15:33:15.918622 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.918596 2578 generic.go:356] "Generic (PLEG): container finished" podID="8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" containerID="11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a" exitCode=0 Jul 09 15:33:15.918734 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.918647 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" Jul 09 15:33:15.918734 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.918651 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" event={"ID":"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1","Type":"ContainerDied","Data":"11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a"} Jul 09 15:33:15.918826 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.918734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" event={"ID":"8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1","Type":"ContainerDied","Data":"91025fdfeb223d56e63745b6ce3339ccbf03165a4171c5e43d244c1e16e8afff"} Jul 09 15:33:15.918826 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.918759 2578 scope.go:117] "RemoveContainer" containerID="11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a" Jul 09 15:33:15.923925 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.923900 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-tls\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.923925 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.923923 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-trusted-ca\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.924074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.923933 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-bound-sa-token\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.924074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.923943 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-ca-trust-extracted\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.924074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.923957 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-registry-certificates\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.924074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.923973 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-installation-pull-secrets\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.924074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.923987 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-image-registry-private-configuration\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.924074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.924003 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prtjm\" (UniqueName: \"kubernetes.io/projected/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1-kube-api-access-prtjm\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:33:15.928745 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.928415 2578 scope.go:117] "RemoveContainer" containerID="11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a" Jul 09 15:33:15.930021 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:33:15.929983 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a\": container with ID starting with 11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a not found: ID does not exist" containerID="11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a" Jul 09 15:33:15.930116 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.930033 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a"} err="failed to get container status \"11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a\": rpc error: code = NotFound desc = could not find container \"11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a\": container with ID starting with 11a8e9729edc74a32bf4cce743315386be4b580c3a9fb8cdffde10d568c8127a not found: ID does not exist" Jul 09 15:33:15.957684 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.957649 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5745cb5c85-5rq49"] Jul 09 15:33:15.963772 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:15.963746 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5745cb5c85-5rq49"] Jul 09 15:33:16.388965 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:16.388932 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" path="/var/lib/kubelet/pods/8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1/volumes" Jul 09 15:33:16.924437 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:16.924388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-x52ds" event={"ID":"778ef260-1256-44b9-a53d-c9a82135ee78","Type":"ContainerStarted","Data":"9d6d3f50c1a1ca13189797c5ec14ec3a840e28eda49c4f4d10552f6b0024c355"} Jul 09 15:33:20.725217 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:20.725100 2578 patch_prober.go:28] interesting pod/image-registry-5745cb5c85-5rq49 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.7:5000/healthz\": context deadline exceeded" start-of-body= Jul 09 15:33:20.725217 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:20.725173 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5745cb5c85-5rq49" podUID="8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.7:5000/healthz\": context deadline exceeded" Jul 09 15:33:20.941187 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:20.941155 2578 generic.go:356] "Generic (PLEG): container finished" podID="1c177890-f1f5-4008-82ce-49d6ed1cb63f" containerID="7cb6cb01781d652a5b0965f612bd50d5837b283d78e2fb401e622ecc09e948d6" exitCode=0 Jul 09 15:33:20.941343 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:20.941192 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" event={"ID":"1c177890-f1f5-4008-82ce-49d6ed1cb63f","Type":"ContainerDied","Data":"7cb6cb01781d652a5b0965f612bd50d5837b283d78e2fb401e622ecc09e948d6"} Jul 09 15:33:20.941514 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:20.941499 2578 scope.go:117] "RemoveContainer" containerID="7cb6cb01781d652a5b0965f612bd50d5837b283d78e2fb401e622ecc09e948d6" Jul 09 15:33:21.946203 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:21.946166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m4scp" event={"ID":"1c177890-f1f5-4008-82ce-49d6ed1cb63f","Type":"ContainerStarted","Data":"d158f6fcc71d37c108073c19999abe9e5990561381b49454cfdcb677407038b8"} Jul 09 15:33:22.861381 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:22.861344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:22.962863 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:22.962810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:29.945760 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:29.945727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:30.007671 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:33:30.007627 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:03.202875 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:03.202839 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:03.271842 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:03.271806 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:16.185613 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:16.185576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:21.140441 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:21.140397 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:23.351043 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:23.351006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:23.637127 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:23.637040 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:28.466211 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.466179 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q"] Jul 09 15:34:28.466618 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.466426 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" containerName="registry" Jul 09 15:34:28.466618 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.466436 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" containerName="registry" Jul 09 15:34:28.466618 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.466483 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8feb5e3e-dbc3-4916-9d63-ec2ae84cbcc1" containerName="registry" Jul 09 15:34:28.470048 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.470023 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.473101 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.473072 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 15:34:28.473238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.473163 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 15:34:28.473238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.473198 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 15:34:28.473361 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.473167 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 15:34:28.473554 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.473540 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 15:34:28.474443 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.474366 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q4vqq\"" Jul 09 15:34:28.480166 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.480137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 15:34:28.483358 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.483331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q"] Jul 09 15:34:28.544221 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544182 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-federate-client-tls\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.544221 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d62zx\" (UniqueName: \"kubernetes.io/projected/371441d4-56b7-423c-8d5a-91402842b5bb-kube-api-access-d62zx\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.544458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-serving-certs-ca-bundle\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.544458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.544458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-telemeter-client-tls\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.544458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-secret-telemeter-client\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.544458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544348 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.544458 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.544429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-metrics-client-ca\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.645507 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-metrics-client-ca\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.645728 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-federate-client-tls\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.645728 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d62zx\" (UniqueName: \"kubernetes.io/projected/371441d4-56b7-423c-8d5a-91402842b5bb-kube-api-access-d62zx\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.645728 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645606 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-serving-certs-ca-bundle\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.645728 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.645728 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-telemeter-client-tls\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.645728 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-secret-telemeter-client\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.646037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.645731 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.646401 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.646366 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-metrics-client-ca\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.646523 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.646489 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.646589 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.646517 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/371441d4-56b7-423c-8d5a-91402842b5bb-serving-certs-ca-bundle\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.648278 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.648254 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-federate-client-tls\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.648361 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.648329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.648625 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.648602 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-telemeter-client-tls\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.648721 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.648681 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/371441d4-56b7-423c-8d5a-91402842b5bb-secret-telemeter-client\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.657353 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.657322 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d62zx\" (UniqueName: \"kubernetes.io/projected/371441d4-56b7-423c-8d5a-91402842b5bb-kube-api-access-d62zx\") pod \"telemeter-client-c84dfd4fb-vzt9q\" (UID: \"371441d4-56b7-423c-8d5a-91402842b5bb\") " pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.782525 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.782437 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" Jul 09 15:34:28.920996 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:28.920966 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q"] Jul 09 15:34:28.923500 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:34:28.923458 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371441d4_56b7_423c_8d5a_91402842b5bb.slice/crio-ecef986fc51b001bfba0651917558e2856b2aa5732fbe99b744f368b71e89e14 WatchSource:0}: Error finding container ecef986fc51b001bfba0651917558e2856b2aa5732fbe99b744f368b71e89e14: Status 404 returned error can't find the container with id ecef986fc51b001bfba0651917558e2856b2aa5732fbe99b744f368b71e89e14 Jul 09 15:34:29.185063 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:29.185026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" event={"ID":"371441d4-56b7-423c-8d5a-91402842b5bb","Type":"ContainerStarted","Data":"ecef986fc51b001bfba0651917558e2856b2aa5732fbe99b744f368b71e89e14"} Jul 09 15:34:32.197785 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:32.197745 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" event={"ID":"371441d4-56b7-423c-8d5a-91402842b5bb","Type":"ContainerStarted","Data":"2e0e84318229f81b02a032c1f35d2456f5241936683b17efb3e8ef5c47323f59"} Jul 09 15:34:34.207257 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:34.207218 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" event={"ID":"371441d4-56b7-423c-8d5a-91402842b5bb","Type":"ContainerStarted","Data":"66958dfb79ae4718f0d1144296e8dd011edd625ada679eb82f97a4dc22316729"} Jul 09 15:34:34.207854 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:34.207295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" event={"ID":"371441d4-56b7-423c-8d5a-91402842b5bb","Type":"ContainerStarted","Data":"006841cd0f75c9237bc92666dbd66b0847a5c0948575942bb00351eebb644ad2"} Jul 09 15:34:34.244918 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:34.244674 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-c84dfd4fb-vzt9q" podStartSLOduration=1.9360211280000001 podStartE2EDuration="6.24465224s" totalImagesPullingTime="4.308631112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:34:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:34:34.243171427 +0000 UTC m=+202.530764163" watchObservedRunningTime="2026-07-09 15:34:34.24465224 +0000 UTC m=+202.532244939" Jul 09 15:34:35.110434 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:35.110400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:35.166290 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:35.166254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:38.627293 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:38.627256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:38.681630 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:38.681595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:50.571629 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:50.571594 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:50.672117 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:50.672082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:51.250218 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:51.250179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:51.350904 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:51.350865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:51.451543 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:51.451509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:59.954068 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:34:59.954027 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:00.055431 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:35:00.055386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:21.238100 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:35:21.238065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:39.302485 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:35:39.302398 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:39.396761 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:35:39.396732 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:46.596933 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:35:46.596890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:05.869103 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:05.869071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:06.843868 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:06.843827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:09.514055 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:09.514019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:09.609230 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:09.609197 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:11.256785 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.256751 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:11.356022 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.355989 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:11.492034 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.492004 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vdp48"] Jul 09 15:36:11.494923 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.494907 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.498402 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.498377 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 15:36:11.499292 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.499266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-k62fz\"" Jul 09 15:36:11.499386 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.499298 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 15:36:11.508493 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.508434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95a74ff7-a9f8-4e16-94f0-a599ad2d786f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vdp48\" (UID: \"95a74ff7-a9f8-4e16-94f0-a599ad2d786f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.508582 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.508496 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4thd\" (UniqueName: \"kubernetes.io/projected/95a74ff7-a9f8-4e16-94f0-a599ad2d786f-kube-api-access-n4thd\") pod \"cert-manager-webhook-6486ffd997-vdp48\" (UID: \"95a74ff7-a9f8-4e16-94f0-a599ad2d786f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.509260 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.509242 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vdp48"] Jul 09 15:36:11.609401 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.609358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4thd\" (UniqueName: \"kubernetes.io/projected/95a74ff7-a9f8-4e16-94f0-a599ad2d786f-kube-api-access-n4thd\") pod \"cert-manager-webhook-6486ffd997-vdp48\" (UID: \"95a74ff7-a9f8-4e16-94f0-a599ad2d786f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.609401 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.609408 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95a74ff7-a9f8-4e16-94f0-a599ad2d786f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vdp48\" (UID: \"95a74ff7-a9f8-4e16-94f0-a599ad2d786f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.619605 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.619571 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95a74ff7-a9f8-4e16-94f0-a599ad2d786f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-vdp48\" (UID: \"95a74ff7-a9f8-4e16-94f0-a599ad2d786f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.620974 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.620955 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4thd\" (UniqueName: \"kubernetes.io/projected/95a74ff7-a9f8-4e16-94f0-a599ad2d786f-kube-api-access-n4thd\") pod \"cert-manager-webhook-6486ffd997-vdp48\" (UID: \"95a74ff7-a9f8-4e16-94f0-a599ad2d786f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.803286 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.803248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:11.827314 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.827279 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:11.928308 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.928281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:11.942503 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:11.942479 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-vdp48"] Jul 09 15:36:12.126651 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:12.126577 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:36:12.129991 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:12.129969 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:36:12.136274 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:12.136256 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 15:36:12.136629 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:12.136611 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:36:12.139789 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:12.139772 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:36:12.540278 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:12.540094 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" event={"ID":"95a74ff7-a9f8-4e16-94f0-a599ad2d786f","Type":"ContainerStarted","Data":"817a92cbd29b4e5e4af76fed0fd9f8747453d20d1ec8fb94589b98e24dd276c2"} Jul 09 15:36:13.495042 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.495005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:13.585842 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.585807 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m"] Jul 09 15:36:13.589015 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.588993 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:13.591897 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.591877 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-p9djc\"" Jul 09 15:36:13.601035 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.600989 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m"] Jul 09 15:36:13.624517 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.624485 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/437d1a0a-026c-4b25-aa36-c36905b0bfe8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sqw7m\" (UID: \"437d1a0a-026c-4b25-aa36-c36905b0bfe8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:13.624708 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.624558 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjq72\" (UniqueName: \"kubernetes.io/projected/437d1a0a-026c-4b25-aa36-c36905b0bfe8-kube-api-access-xjq72\") pod \"cert-manager-cainjector-559cdd8c87-sqw7m\" (UID: \"437d1a0a-026c-4b25-aa36-c36905b0bfe8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:13.683391 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.683353 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:13.725706 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.725657 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjq72\" (UniqueName: \"kubernetes.io/projected/437d1a0a-026c-4b25-aa36-c36905b0bfe8-kube-api-access-xjq72\") pod \"cert-manager-cainjector-559cdd8c87-sqw7m\" (UID: \"437d1a0a-026c-4b25-aa36-c36905b0bfe8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:13.725873 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.725771 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/437d1a0a-026c-4b25-aa36-c36905b0bfe8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sqw7m\" (UID: \"437d1a0a-026c-4b25-aa36-c36905b0bfe8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:13.736660 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.736635 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/437d1a0a-026c-4b25-aa36-c36905b0bfe8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-sqw7m\" (UID: \"437d1a0a-026c-4b25-aa36-c36905b0bfe8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:13.737060 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.737036 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjq72\" (UniqueName: \"kubernetes.io/projected/437d1a0a-026c-4b25-aa36-c36905b0bfe8-kube-api-access-xjq72\") pod \"cert-manager-cainjector-559cdd8c87-sqw7m\" (UID: \"437d1a0a-026c-4b25-aa36-c36905b0bfe8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:13.899252 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:13.899220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" Jul 09 15:36:14.052192 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:14.052029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m"] Jul 09 15:36:14.055103 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:36:14.055075 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod437d1a0a_026c_4b25_aa36_c36905b0bfe8.slice/crio-572539813eb91b3d66ba74f9a2562e00b04c83c017c1dc0b136a91548e8226b6 WatchSource:0}: Error finding container 572539813eb91b3d66ba74f9a2562e00b04c83c017c1dc0b136a91548e8226b6: Status 404 returned error can't find the container with id 572539813eb91b3d66ba74f9a2562e00b04c83c017c1dc0b136a91548e8226b6 Jul 09 15:36:14.057611 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:14.057593 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:36:14.549820 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:14.549791 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" event={"ID":"437d1a0a-026c-4b25-aa36-c36905b0bfe8","Type":"ContainerStarted","Data":"572539813eb91b3d66ba74f9a2562e00b04c83c017c1dc0b136a91548e8226b6"} Jul 09 15:36:16.522137 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:16.522097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:17.564055 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.564004 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" event={"ID":"95a74ff7-a9f8-4e16-94f0-a599ad2d786f","Type":"ContainerStarted","Data":"52f3243a125ff089eef3a5fe1f56974d2a14fc10034bf8ac1adf9cbc0f196f73"} Jul 09 15:36:17.564505 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.564118 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:17.565569 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.565545 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" event={"ID":"437d1a0a-026c-4b25-aa36-c36905b0bfe8","Type":"ContainerStarted","Data":"5f87e274dad78f9460939822d56bff00ec7fff10738c8b009a5ea4e189097a71"} Jul 09 15:36:17.587938 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.587887 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" podStartSLOduration=1.108749233 podStartE2EDuration="6.587872618s" totalImagesPullingTime="5.479123385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:36:17.587324465 +0000 UTC m=+305.874917165" watchObservedRunningTime="2026-07-09 15:36:17.587872618 +0000 UTC m=+305.875465316" Jul 09 15:36:17.613401 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.613346 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-sqw7m" podStartSLOduration=1.596355701 podStartE2EDuration="4.613328257s" totalImagesPullingTime="3.016972556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:36:17.611950858 +0000 UTC m=+305.899543557" watchObservedRunningTime="2026-07-09 15:36:17.613328257 +0000 UTC m=+305.900920955" Jul 09 15:36:17.781872 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.781789 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:17.904118 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.904087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:17.957825 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:17.957794 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:21.494235 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:21.494198 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:23.571766 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:23.571735 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-vdp48" Jul 09 15:36:24.160868 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:24.160832 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:24.260047 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:24.260013 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:29.875479 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:29.875446 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:29.980330 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:29.980298 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:32.179201 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:32.179168 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:33.315316 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:33.315278 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:47.714291 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:47.714252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:47.814615 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:47.814574 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:48.527630 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.527600 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:48.933053 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.933009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:48.969510 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.969482 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp"] Jul 09 15:36:48.973987 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.973966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:48.977846 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.977825 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 15:36:48.977971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.977822 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 15:36:48.977971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.977836 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 15:36:48.977971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.977923 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-44wlf\"" Jul 09 15:36:48.978336 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.978322 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 15:36:48.986828 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:48.986806 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp"] Jul 09 15:36:49.016280 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.016247 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.085703 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.085669 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.088841 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.088821 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-webhook-cert\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.088903 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.088860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-manifests\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.088903 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.088885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps9nf\" (UniqueName: \"kubernetes.io/projected/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-kube-api-access-ps9nf\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.088973 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.088938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-tmp\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.089006 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.088975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.188497 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.188404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.189485 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.189464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-manifests\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.189553 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.189499 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps9nf\" (UniqueName: \"kubernetes.io/projected/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-kube-api-access-ps9nf\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.189553 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.189522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-tmp\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.189649 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.189571 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.189649 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.189624 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-webhook-cert\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.189936 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.189906 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-manifests\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.192196 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.192165 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-tmp\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.192324 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.192174 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.192384 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.192370 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-webhook-cert\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.203553 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.203523 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps9nf\" (UniqueName: \"kubernetes.io/projected/cea3a6b9-475e-4fa7-9f90-ee2f903a722f-kube-api-access-ps9nf\") pod \"opendatahub-operator-controller-manager-9bb557cf6-628pp\" (UID: \"cea3a6b9-475e-4fa7-9f90-ee2f903a722f\") " pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.284234 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.284195 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:49.288074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.288048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.391341 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.391304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.433952 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.433919 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp"] Jul 09 15:36:49.437513 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:36:49.437486 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea3a6b9_475e_4fa7_9f90_ee2f903a722f.slice/crio-6f3f7909e0226e96eb3af64acdfdc7810385810505ac1717886208d2cf240b9d WatchSource:0}: Error finding container 6f3f7909e0226e96eb3af64acdfdc7810385810505ac1717886208d2cf240b9d: Status 404 returned error can't find the container with id 6f3f7909e0226e96eb3af64acdfdc7810385810505ac1717886208d2cf240b9d Jul 09 15:36:49.491659 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.491624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.597571 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.597535 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.684123 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.684087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" event={"ID":"cea3a6b9-475e-4fa7-9f90-ee2f903a722f","Type":"ContainerStarted","Data":"6f3f7909e0226e96eb3af64acdfdc7810385810505ac1717886208d2cf240b9d"} Jul 09 15:36:49.691616 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:49.691536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:52.700885 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:52.700851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" event={"ID":"cea3a6b9-475e-4fa7-9f90-ee2f903a722f","Type":"ContainerStarted","Data":"bf192df64ee33eb18c5230c6dfd1f72133cc692a50af50bb78a25f37738995a8"} Jul 09 15:36:53.705977 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:53.705942 2578 generic.go:356] "Generic (PLEG): container finished" podID="cea3a6b9-475e-4fa7-9f90-ee2f903a722f" containerID="bf192df64ee33eb18c5230c6dfd1f72133cc692a50af50bb78a25f37738995a8" exitCode=0 Jul 09 15:36:53.705977 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:53.705982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" event={"ID":"cea3a6b9-475e-4fa7-9f90-ee2f903a722f","Type":"ContainerDied","Data":"bf192df64ee33eb18c5230c6dfd1f72133cc692a50af50bb78a25f37738995a8"} Jul 09 15:36:54.712347 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:54.712299 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" event={"ID":"cea3a6b9-475e-4fa7-9f90-ee2f903a722f","Type":"ContainerStarted","Data":"9898ab49ba1175a60baf89bca4af042cac9ec590224e1dd2c2752007ca4e8af0"} Jul 09 15:36:54.712736 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:54.712401 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:36:54.745573 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:54.745517 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" podStartSLOduration=2.255910085 podStartE2EDuration="6.745497984s" totalImagesPullingTime="3.407454381s" totalInitContainerRuntime="1.082133518s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:36:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:36:54.74422678 +0000 UTC m=+343.031819502" watchObservedRunningTime="2026-07-09 15:36:54.745497984 +0000 UTC m=+343.033090681" Jul 09 15:36:56.241016 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:56.240953 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:56.301572 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:36:56.301538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:00.566370 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:00.566336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:00.662997 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:00.662963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:05.719137 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:05.719060 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9bb557cf6-628pp" Jul 09 15:37:23.521371 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:23.521330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:23.811028 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:23.810996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:24.174899 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.174817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:24.353230 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.353190 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57f9565468-6r8gb"] Jul 09 15:37:24.360592 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.360555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.363765 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.363737 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 15:37:24.363920 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.363875 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wlwsq\"" Jul 09 15:37:24.364167 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.364148 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 15:37:24.364855 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.364837 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 15:37:24.364944 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.364873 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 15:37:24.369255 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.369219 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57f9565468-6r8gb"] Jul 09 15:37:24.468872 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.468776 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a585f98-7117-4e74-a5c8-175b08c19ff8-tmp\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.468872 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.468818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7q2g\" (UniqueName: \"kubernetes.io/projected/8a585f98-7117-4e74-a5c8-175b08c19ff8-kube-api-access-w7q2g\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.469052 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.468929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a585f98-7117-4e74-a5c8-175b08c19ff8-tls-certs\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.541290 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.541252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:24.569648 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.569603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a585f98-7117-4e74-a5c8-175b08c19ff8-tls-certs\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.569991 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.569953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a585f98-7117-4e74-a5c8-175b08c19ff8-tmp\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.570132 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.570007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7q2g\" (UniqueName: \"kubernetes.io/projected/8a585f98-7117-4e74-a5c8-175b08c19ff8-kube-api-access-w7q2g\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.572111 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.572088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a585f98-7117-4e74-a5c8-175b08c19ff8-tmp\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.572275 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.572257 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a585f98-7117-4e74-a5c8-175b08c19ff8-tls-certs\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.585805 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.585771 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7q2g\" (UniqueName: \"kubernetes.io/projected/8a585f98-7117-4e74-a5c8-175b08c19ff8-kube-api-access-w7q2g\") pod \"kube-auth-proxy-57f9565468-6r8gb\" (UID: \"8a585f98-7117-4e74-a5c8-175b08c19ff8\") " pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.623867 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.623816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:24.671280 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.671241 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" Jul 09 15:37:24.722961 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.722933 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:24.816537 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.816512 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57f9565468-6r8gb"] Jul 09 15:37:24.818584 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:37:24.818557 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a585f98_7117_4e74_a5c8_175b08c19ff8.slice/crio-5bebaec011666aa00b8a18cf65ce191a92a9bd1a49122e024835c0a1b255a536 WatchSource:0}: Error finding container 5bebaec011666aa00b8a18cf65ce191a92a9bd1a49122e024835c0a1b255a536: Status 404 returned error can't find the container with id 5bebaec011666aa00b8a18cf65ce191a92a9bd1a49122e024835c0a1b255a536 Jul 09 15:37:24.828214 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.828184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" event={"ID":"8a585f98-7117-4e74-a5c8-175b08c19ff8","Type":"ContainerStarted","Data":"5bebaec011666aa00b8a18cf65ce191a92a9bd1a49122e024835c0a1b255a536"} Jul 09 15:37:24.897514 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:24.897477 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:25.212802 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.212766 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:25.697710 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.697659 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fdc99"] Jul 09 15:37:25.700261 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.700234 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:25.703703 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.703657 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 15:37:25.723881 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.723841 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:25.730028 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.729984 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fdc99"] Jul 09 15:37:25.777983 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.777950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8mnq\" (UniqueName: \"kubernetes.io/projected/d721bf01-9b74-431e-97dd-b0382e33aeac-kube-api-access-x8mnq\") pod \"model-serving-api-54d89bd5fc-fdc99\" (UID: \"d721bf01-9b74-431e-97dd-b0382e33aeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:25.778176 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.778018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d721bf01-9b74-431e-97dd-b0382e33aeac-tls-certs\") pod \"model-serving-api-54d89bd5fc-fdc99\" (UID: \"d721bf01-9b74-431e-97dd-b0382e33aeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:25.879260 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.879227 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mnq\" (UniqueName: \"kubernetes.io/projected/d721bf01-9b74-431e-97dd-b0382e33aeac-kube-api-access-x8mnq\") pod \"model-serving-api-54d89bd5fc-fdc99\" (UID: \"d721bf01-9b74-431e-97dd-b0382e33aeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:25.879487 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.879279 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d721bf01-9b74-431e-97dd-b0382e33aeac-tls-certs\") pod \"model-serving-api-54d89bd5fc-fdc99\" (UID: \"d721bf01-9b74-431e-97dd-b0382e33aeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:25.879487 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:37:25.879400 2578 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 15:37:25.879487 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:37:25.879462 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d721bf01-9b74-431e-97dd-b0382e33aeac-tls-certs podName:d721bf01-9b74-431e-97dd-b0382e33aeac nodeName:}" failed. No retries permitted until 2026-07-09 15:37:26.379446053 +0000 UTC m=+374.667038729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d721bf01-9b74-431e-97dd-b0382e33aeac-tls-certs") pod "model-serving-api-54d89bd5fc-fdc99" (UID: "d721bf01-9b74-431e-97dd-b0382e33aeac") : secret "model-serving-api-tls" not found Jul 09 15:37:25.894372 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.894336 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8mnq\" (UniqueName: \"kubernetes.io/projected/d721bf01-9b74-431e-97dd-b0382e33aeac-kube-api-access-x8mnq\") pod \"model-serving-api-54d89bd5fc-fdc99\" (UID: \"d721bf01-9b74-431e-97dd-b0382e33aeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:25.970166 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:25.970055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:26.059373 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:26.059336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:26.383835 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:26.383794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d721bf01-9b74-431e-97dd-b0382e33aeac-tls-certs\") pod \"model-serving-api-54d89bd5fc-fdc99\" (UID: \"d721bf01-9b74-431e-97dd-b0382e33aeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:26.386718 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:26.386673 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d721bf01-9b74-431e-97dd-b0382e33aeac-tls-certs\") pod \"model-serving-api-54d89bd5fc-fdc99\" (UID: \"d721bf01-9b74-431e-97dd-b0382e33aeac\") " pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:26.612815 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:26.612772 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:26.765955 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:26.765928 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fdc99"] Jul 09 15:37:26.768538 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:37:26.768511 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd721bf01_9b74_431e_97dd_b0382e33aeac.slice/crio-06d8ca9adc792eefa8eaa2b1ade1a79d118af8f1878881c4f35a0faed5e13931 WatchSource:0}: Error finding container 06d8ca9adc792eefa8eaa2b1ade1a79d118af8f1878881c4f35a0faed5e13931: Status 404 returned error can't find the container with id 06d8ca9adc792eefa8eaa2b1ade1a79d118af8f1878881c4f35a0faed5e13931 Jul 09 15:37:26.840765 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:26.840718 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" event={"ID":"d721bf01-9b74-431e-97dd-b0382e33aeac","Type":"ContainerStarted","Data":"06d8ca9adc792eefa8eaa2b1ade1a79d118af8f1878881c4f35a0faed5e13931"} Jul 09 15:37:27.207829 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:27.207770 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:27.846047 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:27.846008 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" event={"ID":"8a585f98-7117-4e74-a5c8-175b08c19ff8","Type":"ContainerStarted","Data":"28b45754c5ae749c75ffef3b3c50e333a4008e06b8a485278551bfa3e4ee480d"} Jul 09 15:37:27.866568 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:27.866512 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57f9565468-6r8gb" podStartSLOduration=1.001933852 podStartE2EDuration="3.866495815s" totalImagesPullingTime="2.864561963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:27.865550865 +0000 UTC m=+376.153143564" watchObservedRunningTime="2026-07-09 15:37:27.866495815 +0000 UTC m=+376.154088512" Jul 09 15:37:29.856164 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:29.856126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" event={"ID":"d721bf01-9b74-431e-97dd-b0382e33aeac","Type":"ContainerStarted","Data":"36c70546b2a27d7a4c3292c4bc3dc8f8056d7bdff346c6d439ce3b249c004e17"} Jul 09 15:37:29.856621 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:29.856212 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:29.875741 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:29.875660 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" podStartSLOduration=2.6111841829999998 podStartE2EDuration="4.87563892s" totalImagesPullingTime="2.264454737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:29.874616465 +0000 UTC m=+378.162209163" watchObservedRunningTime="2026-07-09 15:37:29.87563892 +0000 UTC m=+378.163231620" Jul 09 15:37:30.672961 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:30.672927 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:30.963579 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:30.963502 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc"] Jul 09 15:37:30.966981 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:30.966958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:30.969862 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:30.969842 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-sncfn\"" Jul 09 15:37:30.969949 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:30.969887 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 15:37:30.980401 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:30.980377 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc"] Jul 09 15:37:31.025305 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220c7954-9195-48dc-a360-10e324c31a16-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025305 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025540 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025540 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025540 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220c7954-9195-48dc-a360-10e324c31a16-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025540 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025451 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6rm\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-kube-api-access-fj6rm\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025540 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025476 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025540 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.025540 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.025523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.126821 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220c7954-9195-48dc-a360-10e324c31a16-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.126821 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126831 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126854 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126877 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220c7954-9195-48dc-a360-10e324c31a16-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6rm\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-kube-api-access-fj6rm\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126957 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127074 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.126986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127483 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.127398 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127483 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.127422 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127590 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.127518 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127770 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.127748 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.127849 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.127820 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220c7954-9195-48dc-a360-10e324c31a16-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.129298 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.129276 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.129385 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.129371 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220c7954-9195-48dc-a360-10e324c31a16-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.139514 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.139483 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6rm\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-kube-api-access-fj6rm\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.139656 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.139623 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-j5hrc\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.237558 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.237475 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q"] Jul 09 15:37:31.241831 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.241809 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.260382 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.260346 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q"] Jul 09 15:37:31.276801 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.276761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:31.328514 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328670 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328670 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328630 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328825 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328684 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8z8w\" (UniqueName: \"kubernetes.io/projected/40ab11d7-916c-40b2-a96b-b5c08b144d14-kube-api-access-m8z8w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328825 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328744 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328825 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328812 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328987 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ab11d7-916c-40b2-a96b-b5c08b144d14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328987 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.328987 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.328947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429620 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429782 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8z8w\" (UniqueName: \"kubernetes.io/projected/40ab11d7-916c-40b2-a96b-b5c08b144d14-kube-api-access-m8z8w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429830 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429903 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ab11d7-916c-40b2-a96b-b5c08b144d14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.429979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430149 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.430015 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.430781 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.430746 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.431158 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.431106 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.431158 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.431136 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.431420 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.431397 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.432954 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.432108 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40ab11d7-916c-40b2-a96b-b5c08b144d14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.432954 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.432558 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc"] Jul 09 15:37:31.433124 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.433081 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.433124 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.433095 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.434887 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:37:31.434865 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220c7954_9195_48dc_a360_10e324c31a16.slice/crio-5c56b599f1b2c03654d47c14084d0169f33812bc6fb787c6deb1caa5546a72e1 WatchSource:0}: Error finding container 5c56b599f1b2c03654d47c14084d0169f33812bc6fb787c6deb1caa5546a72e1: Status 404 returned error can't find the container with id 5c56b599f1b2c03654d47c14084d0169f33812bc6fb787c6deb1caa5546a72e1 Jul 09 15:37:31.442508 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.442477 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40ab11d7-916c-40b2-a96b-b5c08b144d14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.442605 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.442567 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8z8w\" (UniqueName: \"kubernetes.io/projected/40ab11d7-916c-40b2-a96b-b5c08b144d14-kube-api-access-m8z8w\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678vrk6q\" (UID: \"40ab11d7-916c-40b2-a96b-b5c08b144d14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.552143 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.552110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:31.694093 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.694060 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q"] Jul 09 15:37:31.696759 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:37:31.696732 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ab11d7_916c_40b2_a96b_b5c08b144d14.slice/crio-551682d7036a061dc4bacf8ef62d52195617c53498d8ac25faacb2348559992f WatchSource:0}: Error finding container 551682d7036a061dc4bacf8ef62d52195617c53498d8ac25faacb2348559992f: Status 404 returned error can't find the container with id 551682d7036a061dc4bacf8ef62d52195617c53498d8ac25faacb2348559992f Jul 09 15:37:31.874978 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.874874 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" event={"ID":"220c7954-9195-48dc-a360-10e324c31a16","Type":"ContainerStarted","Data":"5c56b599f1b2c03654d47c14084d0169f33812bc6fb787c6deb1caa5546a72e1"} Jul 09 15:37:31.876244 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:31.876211 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" event={"ID":"40ab11d7-916c-40b2-a96b-b5c08b144d14","Type":"ContainerStarted","Data":"551682d7036a061dc4bacf8ef62d52195617c53498d8ac25faacb2348559992f"} Jul 09 15:37:32.575891 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.575842 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx"] Jul 09 15:37:32.579967 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.579937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.583310 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.583231 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:37:32.583551 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.583470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 15:37:32.585260 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.585230 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 15:37:32.585530 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.585488 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 15:37:32.600486 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.600260 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cv98g\"" Jul 09 15:37:32.600486 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.600453 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 15:37:32.602856 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.602831 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx"] Jul 09 15:37:32.640466 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.640428 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2af14a2e-f381-46d9-b0a6-e4a022316e1c-manager-config\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.640647 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.640477 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttsdn\" (UniqueName: \"kubernetes.io/projected/2af14a2e-f381-46d9-b0a6-e4a022316e1c-kube-api-access-ttsdn\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.640647 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.640516 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2af14a2e-f381-46d9-b0a6-e4a022316e1c-cert\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.640647 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.640603 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2af14a2e-f381-46d9-b0a6-e4a022316e1c-metrics-cert\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.741599 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.741557 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2af14a2e-f381-46d9-b0a6-e4a022316e1c-manager-config\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.741822 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.741608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttsdn\" (UniqueName: \"kubernetes.io/projected/2af14a2e-f381-46d9-b0a6-e4a022316e1c-kube-api-access-ttsdn\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.741822 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.741651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2af14a2e-f381-46d9-b0a6-e4a022316e1c-cert\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.741822 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.741719 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2af14a2e-f381-46d9-b0a6-e4a022316e1c-metrics-cert\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.742568 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.742519 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2af14a2e-f381-46d9-b0a6-e4a022316e1c-manager-config\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.744946 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.744841 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2af14a2e-f381-46d9-b0a6-e4a022316e1c-metrics-cert\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.745800 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.745759 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2af14a2e-f381-46d9-b0a6-e4a022316e1c-cert\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.753685 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.753550 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttsdn\" (UniqueName: \"kubernetes.io/projected/2af14a2e-f381-46d9-b0a6-e4a022316e1c-kube-api-access-ttsdn\") pod \"lws-controller-manager-5c8fc68c98-x2cqx\" (UID: \"2af14a2e-f381-46d9-b0a6-e4a022316e1c\") " pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:32.894926 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:32.894847 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:33.073732 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:33.073701 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx"] Jul 09 15:37:33.076301 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:37:33.076268 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af14a2e_f381_46d9_b0a6_e4a022316e1c.slice/crio-639548a4a84a173f67bbf2c8eacf940b9602f9618477a56e5fb02bf15cd687db WatchSource:0}: Error finding container 639548a4a84a173f67bbf2c8eacf940b9602f9618477a56e5fb02bf15cd687db: Status 404 returned error can't find the container with id 639548a4a84a173f67bbf2c8eacf940b9602f9618477a56e5fb02bf15cd687db Jul 09 15:37:33.641867 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:33.641836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:33.892414 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:33.892325 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" event={"ID":"2af14a2e-f381-46d9-b0a6-e4a022316e1c","Type":"ContainerStarted","Data":"639548a4a84a173f67bbf2c8eacf940b9602f9618477a56e5fb02bf15cd687db"} Jul 09 15:37:34.403513 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.403471 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 15:37:34.403655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.403545 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 15:37:34.403655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.403575 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 15:37:34.410057 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.410030 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 15:37:34.410160 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.410106 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 15:37:34.410160 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.410138 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 15:37:34.900950 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.900849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" event={"ID":"220c7954-9195-48dc-a360-10e324c31a16","Type":"ContainerStarted","Data":"e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7"} Jul 09 15:37:34.903201 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.903172 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" event={"ID":"40ab11d7-916c-40b2-a96b-b5c08b144d14","Type":"ContainerStarted","Data":"80bbabe437e91d172602f66b757626d77f9ef9b63576a310eeb0c35c1f134fa5"} Jul 09 15:37:34.930901 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.930662 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" podStartSLOduration=1.9644103149999999 podStartE2EDuration="4.930640918s" totalImagesPullingTime="2.966230603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:34.92830988 +0000 UTC m=+383.215902612" watchObservedRunningTime="2026-07-09 15:37:34.930640918 +0000 UTC m=+383.218233617" Jul 09 15:37:34.959839 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:34.959778 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" podStartSLOduration=1.249095665 podStartE2EDuration="3.959756735s" totalImagesPullingTime="2.71066107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:34.956023218 +0000 UTC m=+383.243615917" watchObservedRunningTime="2026-07-09 15:37:34.959756735 +0000 UTC m=+383.247349437" Jul 09 15:37:35.277411 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:35.277328 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:35.278629 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:35.278603 2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-j5hrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jul 09 15:37:35.278762 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:35.278655 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" podUID="220c7954-9195-48dc-a360-10e324c31a16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jul 09 15:37:35.552910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:35.552871 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:35.559308 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:35.559274 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:35.908315 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:35.908233 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:35.909567 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:35.909542 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678vrk6q" Jul 09 15:37:36.039669 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.039638 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc"] Jul 09 15:37:36.278105 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.278013 2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-j5hrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jul 09 15:37:36.278105 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.278086 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" podUID="220c7954-9195-48dc-a360-10e324c31a16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jul 09 15:37:36.617410 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.617371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:36.691832 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.691795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:36.799848 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.799814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:36.913810 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.913676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" event={"ID":"2af14a2e-f381-46d9-b0a6-e4a022316e1c","Type":"ContainerStarted","Data":"d96cee9fdbdc90116895be64a1bc6b1cf382812c0f49a0fd2d5507b5db5d3bea"} Jul 09 15:37:36.914263 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.913833 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:36.935633 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:36.935577 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" podStartSLOduration=1.6716819410000001 podStartE2EDuration="4.93555968s" totalImagesPullingTime="3.263877739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:36.934923604 +0000 UTC m=+385.222516336" watchObservedRunningTime="2026-07-09 15:37:36.93555968 +0000 UTC m=+385.223152378" Jul 09 15:37:37.277503 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:37.277411 2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-j5hrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" start-of-body= Jul 09 15:37:37.277503 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:37.277480 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" podUID="220c7954-9195-48dc-a360-10e324c31a16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.22:15021/healthz/ready\": dial tcp 10.132.0.22:15021: connect: connection refused" Jul 09 15:37:37.439200 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:37.439166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:37.918904 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:37.918861 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" podUID="220c7954-9195-48dc-a360-10e324c31a16" containerName="istio-proxy" containerID="cri-o://e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7" gracePeriod=30 Jul 09 15:37:40.143757 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:40.143716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:40.864962 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:40.864933 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fdc99" Jul 09 15:37:42.999799 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:42.999764 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:43.169844 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.169818 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:43.237353 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237261 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-istio-token\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237353 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237327 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-credential-socket\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237353 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237357 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-socket\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237376 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220c7954-9195-48dc-a360-10e324c31a16-istio-podinfo\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237395 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-envoy\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237418 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-certs\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237436 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-data\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237472 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220c7954-9195-48dc-a360-10e324c31a16-istiod-ca-cert\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237503 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj6rm\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-kube-api-access-fj6rm\") pod \"220c7954-9195-48dc-a360-10e324c31a16\" (UID: \"220c7954-9195-48dc-a360-10e324c31a16\") " Jul 09 15:37:43.237640 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237584 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:43.238027 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237755 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:43.238027 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237775 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:43.238027 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237797 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-credential-socket\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.238027 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.237922 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-data" (OuterVolumeSpecName: "istio-data") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:43.238228 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.238039 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/220c7954-9195-48dc-a360-10e324c31a16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:37:43.239760 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.239732 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:43.239760 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.239750 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-kube-api-access-fj6rm" (OuterVolumeSpecName: "kube-api-access-fj6rm") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "kube-api-access-fj6rm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:37:43.239919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.239794 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-istio-token" (OuterVolumeSpecName: "istio-token") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:37:43.239919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.239837 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/220c7954-9195-48dc-a360-10e324c31a16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "220c7954-9195-48dc-a360-10e324c31a16" (UID: "220c7954-9195-48dc-a360-10e324c31a16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 15:37:43.339176 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339137 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/220c7954-9195-48dc-a360-10e324c31a16-istio-podinfo\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.339176 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339168 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-envoy\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.339176 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339178 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-certs\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.339176 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339185 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-istio-data\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.339443 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339194 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/220c7954-9195-48dc-a360-10e324c31a16-istiod-ca-cert\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.339443 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339202 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj6rm\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-kube-api-access-fj6rm\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.339443 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339210 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/220c7954-9195-48dc-a360-10e324c31a16-istio-token\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.339443 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.339219 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/220c7954-9195-48dc-a360-10e324c31a16-workload-socket\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:37:43.947765 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.947729 2578 generic.go:356] "Generic (PLEG): container finished" podID="220c7954-9195-48dc-a360-10e324c31a16" containerID="e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7" exitCode=0 Jul 09 15:37:43.947971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.947775 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" Jul 09 15:37:43.947971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.947821 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" event={"ID":"220c7954-9195-48dc-a360-10e324c31a16","Type":"ContainerDied","Data":"e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7"} Jul 09 15:37:43.947971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.947880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc" event={"ID":"220c7954-9195-48dc-a360-10e324c31a16","Type":"ContainerDied","Data":"5c56b599f1b2c03654d47c14084d0169f33812bc6fb787c6deb1caa5546a72e1"} Jul 09 15:37:43.947971 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.947910 2578 scope.go:117] "RemoveContainer" containerID="e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7" Jul 09 15:37:43.957004 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.956985 2578 scope.go:117] "RemoveContainer" containerID="e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7" Jul 09 15:37:43.957309 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:37:43.957289 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7\": container with ID starting with e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7 not found: ID does not exist" containerID="e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7" Jul 09 15:37:43.957359 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.957317 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7"} err="failed to get container status \"e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7\": rpc error: code = NotFound desc = could not find container \"e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7\": container with ID starting with e375cae0e68c29ae278e3d79fbddc6344c4e7571966f942a2c2e2cc80f2762f7 not found: ID does not exist" Jul 09 15:37:43.974236 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.974206 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc"] Jul 09 15:37:43.980487 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:43.980460 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-j5hrc"] Jul 09 15:37:44.389786 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:44.389754 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="220c7954-9195-48dc-a360-10e324c31a16" path="/var/lib/kubelet/pods/220c7954-9195-48dc-a360-10e324c31a16/volumes" Jul 09 15:37:47.920950 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:47.920916 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c8fc68c98-x2cqx" Jul 09 15:37:55.028933 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:55.028901 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:55.085630 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:37:55.085596 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:24.937654 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:24.937615 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:25.030465 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:25.030428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:25.138258 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:25.138223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:47.432485 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:47.432409 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:47.546989 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:47.546953 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:47.801413 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:47.801384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:51.636980 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:51.636938 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:53.987563 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:53.987525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:55.982729 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:55.982671 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:56.221787 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:56.221751 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:56.382838 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:56.382804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:59.606234 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:59.606201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:59.835970 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:38:59.835918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:02.895345 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:02.895299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:03.251227 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:03.251129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:03.372538 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:03.372499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:03.811822 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:03.811787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:03.873928 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:03.873896 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:11.883080 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:11.883044 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:11.986025 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:11.985985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:16.209469 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:16.209382 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:16.312499 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:16.312461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:17.646032 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:17.645998 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:17.738683 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:17.738647 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:20.606899 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:20.606861 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:20.911771 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:20.911677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:24.439919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:24.439886 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:24.515362 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:24.515329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:30.844542 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:30.844509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:30.906098 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:30.906068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:30.986825 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:30.986795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:37.374736 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:37.374677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:37.474423 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:37.474386 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:41.310423 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:41.310388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:41.375760 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:41.375728 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:44.370805 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:44.370770 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:44.471362 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:44.471329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:52.375081 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:52.375043 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:52.435735 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:52.435682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:55.232376 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:55.232344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:55.363022 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:55.362984 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:59.041539 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:59.041495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:59.142637 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:59.142592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:59.380731 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:59.380673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:59.481307 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:59.481275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:59.974294 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:39:59.974261 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:00.087398 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:00.087363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:00.185669 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:00.185624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:01.009132 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.009095 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-n4q8t"] Jul 09 15:40:01.009435 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.009422 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="220c7954-9195-48dc-a360-10e324c31a16" containerName="istio-proxy" Jul 09 15:40:01.009477 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.009436 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="220c7954-9195-48dc-a360-10e324c31a16" containerName="istio-proxy" Jul 09 15:40:01.009511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.009483 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="220c7954-9195-48dc-a360-10e324c31a16" containerName="istio-proxy" Jul 09 15:40:01.011296 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.011279 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n4q8t" Jul 09 15:40:01.014204 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.014182 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 15:40:01.014415 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.014400 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 15:40:01.016364 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.016345 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wm6mn\"" Jul 09 15:40:01.020711 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.020668 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n4q8t"] Jul 09 15:40:01.063875 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.063838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:01.092042 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.092008 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2jjd\" (UniqueName: \"kubernetes.io/projected/4db572ca-1a94-4e97-8d07-d62da204bf25-kube-api-access-n2jjd\") pod \"authorino-58cd955675-n4q8t\" (UID: \"4db572ca-1a94-4e97-8d07-d62da204bf25\") " pod="kuadrant-system/authorino-58cd955675-n4q8t" Jul 09 15:40:01.193298 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.193260 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2jjd\" (UniqueName: \"kubernetes.io/projected/4db572ca-1a94-4e97-8d07-d62da204bf25-kube-api-access-n2jjd\") pod \"authorino-58cd955675-n4q8t\" (UID: \"4db572ca-1a94-4e97-8d07-d62da204bf25\") " pod="kuadrant-system/authorino-58cd955675-n4q8t" Jul 09 15:40:01.208073 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.208039 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2jjd\" (UniqueName: \"kubernetes.io/projected/4db572ca-1a94-4e97-8d07-d62da204bf25-kube-api-access-n2jjd\") pod \"authorino-58cd955675-n4q8t\" (UID: \"4db572ca-1a94-4e97-8d07-d62da204bf25\") " pod="kuadrant-system/authorino-58cd955675-n4q8t" Jul 09 15:40:01.233444 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.233410 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7btf"] Jul 09 15:40:01.235717 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.235676 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7btf" Jul 09 15:40:01.245250 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.245224 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7btf"] Jul 09 15:40:01.321396 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.321360 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n4q8t" Jul 09 15:40:01.385527 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.385454 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:01.395956 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.395917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfxr\" (UniqueName: \"kubernetes.io/projected/f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472-kube-api-access-5mfxr\") pod \"authorino-75d556bd77-h7btf\" (UID: \"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472\") " pod="kuadrant-system/authorino-75d556bd77-h7btf" Jul 09 15:40:01.457115 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.457077 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-n4q8t"] Jul 09 15:40:01.459816 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:40:01.459789 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4db572ca_1a94_4e97_8d07_d62da204bf25.slice/crio-06af854da8a6b234a75c1cdbafbb3fc053a6145e21acb2922915ba249a898a36 WatchSource:0}: Error finding container 06af854da8a6b234a75c1cdbafbb3fc053a6145e21acb2922915ba249a898a36: Status 404 returned error can't find the container with id 06af854da8a6b234a75c1cdbafbb3fc053a6145e21acb2922915ba249a898a36 Jul 09 15:40:01.496655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.496612 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfxr\" (UniqueName: \"kubernetes.io/projected/f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472-kube-api-access-5mfxr\") pod \"authorino-75d556bd77-h7btf\" (UID: \"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472\") " pod="kuadrant-system/authorino-75d556bd77-h7btf" Jul 09 15:40:01.507668 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.507645 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfxr\" (UniqueName: \"kubernetes.io/projected/f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472-kube-api-access-5mfxr\") pod \"authorino-75d556bd77-h7btf\" (UID: \"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472\") " pod="kuadrant-system/authorino-75d556bd77-h7btf" Jul 09 15:40:01.518109 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.518077 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n4q8t" event={"ID":"4db572ca-1a94-4e97-8d07-d62da204bf25","Type":"ContainerStarted","Data":"06af854da8a6b234a75c1cdbafbb3fc053a6145e21acb2922915ba249a898a36"} Jul 09 15:40:01.545417 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.545380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7btf" Jul 09 15:40:01.679531 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:01.679509 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7btf"] Jul 09 15:40:01.681559 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:40:01.681531 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf84b6d99_b176_4a9c_8fd3_6b9e1a8fb472.slice/crio-781e8fa7a8d066d011ead2a7ba8337d3d1463415d835dbedb9708a8aae846df8 WatchSource:0}: Error finding container 781e8fa7a8d066d011ead2a7ba8337d3d1463415d835dbedb9708a8aae846df8: Status 404 returned error can't find the container with id 781e8fa7a8d066d011ead2a7ba8337d3d1463415d835dbedb9708a8aae846df8 Jul 09 15:40:02.523732 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:02.523675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7btf" event={"ID":"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472","Type":"ContainerStarted","Data":"781e8fa7a8d066d011ead2a7ba8337d3d1463415d835dbedb9708a8aae846df8"} Jul 09 15:40:04.182565 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:04.182370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:04.292870 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:04.292781 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:06.549742 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:06.549684 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n4q8t" event={"ID":"4db572ca-1a94-4e97-8d07-d62da204bf25","Type":"ContainerStarted","Data":"937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22"} Jul 09 15:40:06.551123 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:06.551102 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7btf" event={"ID":"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472","Type":"ContainerStarted","Data":"b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672"} Jul 09 15:40:06.569017 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:06.568967 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-n4q8t" podStartSLOduration=2.305307536 podStartE2EDuration="6.568952976s" totalImagesPullingTime="4.26364544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:40:06.567676601 +0000 UTC m=+534.855269292" watchObservedRunningTime="2026-07-09 15:40:06.568952976 +0000 UTC m=+534.856545673" Jul 09 15:40:06.586814 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:06.586758 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-h7btf" podStartSLOduration=1.532303132 podStartE2EDuration="5.586741591s" totalImagesPullingTime="4.054438459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:40:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:40:06.585774364 +0000 UTC m=+534.873367073" watchObservedRunningTime="2026-07-09 15:40:06.586741591 +0000 UTC m=+534.874334288" Jul 09 15:40:06.617950 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:06.617914 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n4q8t"] Jul 09 15:40:08.559537 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:08.559495 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-n4q8t" podUID="4db572ca-1a94-4e97-8d07-d62da204bf25" containerName="authorino" containerID="cri-o://937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22" gracePeriod=30 Jul 09 15:40:08.811633 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:08.811556 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n4q8t" Jul 09 15:40:08.958530 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:08.958487 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2jjd\" (UniqueName: \"kubernetes.io/projected/4db572ca-1a94-4e97-8d07-d62da204bf25-kube-api-access-n2jjd\") pod \"4db572ca-1a94-4e97-8d07-d62da204bf25\" (UID: \"4db572ca-1a94-4e97-8d07-d62da204bf25\") " Jul 09 15:40:08.960818 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:08.960784 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4db572ca-1a94-4e97-8d07-d62da204bf25-kube-api-access-n2jjd" (OuterVolumeSpecName: "kube-api-access-n2jjd") pod "4db572ca-1a94-4e97-8d07-d62da204bf25" (UID: "4db572ca-1a94-4e97-8d07-d62da204bf25"). InnerVolumeSpecName "kube-api-access-n2jjd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:40:09.059314 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.059274 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2jjd\" (UniqueName: \"kubernetes.io/projected/4db572ca-1a94-4e97-8d07-d62da204bf25-kube-api-access-n2jjd\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:40:09.565350 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.565304 2578 generic.go:356] "Generic (PLEG): container finished" podID="4db572ca-1a94-4e97-8d07-d62da204bf25" containerID="937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22" exitCode=0 Jul 09 15:40:09.565350 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.565338 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-n4q8t" Jul 09 15:40:09.565866 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.565362 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n4q8t" event={"ID":"4db572ca-1a94-4e97-8d07-d62da204bf25","Type":"ContainerDied","Data":"937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22"} Jul 09 15:40:09.565866 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.565405 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-n4q8t" event={"ID":"4db572ca-1a94-4e97-8d07-d62da204bf25","Type":"ContainerDied","Data":"06af854da8a6b234a75c1cdbafbb3fc053a6145e21acb2922915ba249a898a36"} Jul 09 15:40:09.565866 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.565425 2578 scope.go:117] "RemoveContainer" containerID="937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22" Jul 09 15:40:09.573743 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.573725 2578 scope.go:117] "RemoveContainer" containerID="937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22" Jul 09 15:40:09.574051 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:40:09.574033 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22\": container with ID starting with 937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22 not found: ID does not exist" containerID="937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22" Jul 09 15:40:09.574093 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.574062 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22"} err="failed to get container status \"937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22\": rpc error: code = NotFound desc = could not find container \"937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22\": container with ID starting with 937e2a22d2e824c471ed3127dfca351c42da9046ce397d1e9d019fa6f6777d22 not found: ID does not exist" Jul 09 15:40:09.588154 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.588117 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-n4q8t"] Jul 09 15:40:09.592555 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:09.592528 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-n4q8t"] Jul 09 15:40:10.390087 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:10.390056 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4db572ca-1a94-4e97-8d07-d62da204bf25" path="/var/lib/kubelet/pods/4db572ca-1a94-4e97-8d07-d62da204bf25/volumes" Jul 09 15:40:21.262306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:21.262262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:21.352345 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:21.352306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:21.747327 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:21.747291 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:33.551222 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.551189 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:33.791985 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.791944 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:33.852866 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.852774 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w8kjm"] Jul 09 15:40:33.853122 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.853107 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4db572ca-1a94-4e97-8d07-d62da204bf25" containerName="authorino" Jul 09 15:40:33.853168 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.853125 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4db572ca-1a94-4e97-8d07-d62da204bf25" containerName="authorino" Jul 09 15:40:33.853203 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.853184 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4db572ca-1a94-4e97-8d07-d62da204bf25" containerName="authorino" Jul 09 15:40:33.857116 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.857090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" Jul 09 15:40:33.868599 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.868573 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w8kjm"] Jul 09 15:40:33.965993 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:33.965957 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7jtr\" (UniqueName: \"kubernetes.io/projected/9e989aba-4d44-4b0f-a2af-90cdddf805a7-kube-api-access-d7jtr\") pod \"authorino-5d4b67c446-w8kjm\" (UID: \"9e989aba-4d44-4b0f-a2af-90cdddf805a7\") " pod="kuadrant-system/authorino-5d4b67c446-w8kjm" Jul 09 15:40:34.067443 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.067395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7jtr\" (UniqueName: \"kubernetes.io/projected/9e989aba-4d44-4b0f-a2af-90cdddf805a7-kube-api-access-d7jtr\") pod \"authorino-5d4b67c446-w8kjm\" (UID: \"9e989aba-4d44-4b0f-a2af-90cdddf805a7\") " pod="kuadrant-system/authorino-5d4b67c446-w8kjm" Jul 09 15:40:34.078085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.078045 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7jtr\" (UniqueName: \"kubernetes.io/projected/9e989aba-4d44-4b0f-a2af-90cdddf805a7-kube-api-access-d7jtr\") pod \"authorino-5d4b67c446-w8kjm\" (UID: \"9e989aba-4d44-4b0f-a2af-90cdddf805a7\") " pod="kuadrant-system/authorino-5d4b67c446-w8kjm" Jul 09 15:40:34.102745 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.102706 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w8kjm"] Jul 09 15:40:34.103053 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.102989 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" Jul 09 15:40:34.134754 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.134721 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c5747ff48-dl9x6"] Jul 09 15:40:34.138450 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.138421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.141342 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.141315 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 15:40:34.147528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.147500 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5747ff48-dl9x6"] Jul 09 15:40:34.168552 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.168515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9aec5593-67f4-4184-be50-06307cbe2888-tls-cert\") pod \"authorino-5c5747ff48-dl9x6\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.168749 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.168580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2z2n\" (UniqueName: \"kubernetes.io/projected/9aec5593-67f4-4184-be50-06307cbe2888-kube-api-access-k2z2n\") pod \"authorino-5c5747ff48-dl9x6\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.245298 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.245271 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w8kjm"] Jul 09 15:40:34.247999 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:40:34.247968 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9e989aba_4d44_4b0f_a2af_90cdddf805a7.slice/crio-ac2b98abfb59976b5df3a3c8e3368231064fcdfae2f3da3d851a55e3cdca2fd3 WatchSource:0}: Error finding container ac2b98abfb59976b5df3a3c8e3368231064fcdfae2f3da3d851a55e3cdca2fd3: Status 404 returned error can't find the container with id ac2b98abfb59976b5df3a3c8e3368231064fcdfae2f3da3d851a55e3cdca2fd3 Jul 09 15:40:34.269917 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.269886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2z2n\" (UniqueName: \"kubernetes.io/projected/9aec5593-67f4-4184-be50-06307cbe2888-kube-api-access-k2z2n\") pod \"authorino-5c5747ff48-dl9x6\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.270086 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.269977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9aec5593-67f4-4184-be50-06307cbe2888-tls-cert\") pod \"authorino-5c5747ff48-dl9x6\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.272424 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.272396 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9aec5593-67f4-4184-be50-06307cbe2888-tls-cert\") pod \"authorino-5c5747ff48-dl9x6\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.280273 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.280246 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2z2n\" (UniqueName: \"kubernetes.io/projected/9aec5593-67f4-4184-be50-06307cbe2888-kube-api-access-k2z2n\") pod \"authorino-5c5747ff48-dl9x6\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.449383 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.449293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:40:34.588660 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.588631 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c5747ff48-dl9x6"] Jul 09 15:40:34.590910 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:40:34.590883 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9aec5593_67f4_4184_be50_06307cbe2888.slice/crio-5646b2fb8668820358ac91eacdbf58bf7bfecc9782d8dacbc5b7097a16fbb8e9 WatchSource:0}: Error finding container 5646b2fb8668820358ac91eacdbf58bf7bfecc9782d8dacbc5b7097a16fbb8e9: Status 404 returned error can't find the container with id 5646b2fb8668820358ac91eacdbf58bf7bfecc9782d8dacbc5b7097a16fbb8e9 Jul 09 15:40:34.674106 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.674070 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" event={"ID":"9e989aba-4d44-4b0f-a2af-90cdddf805a7","Type":"ContainerStarted","Data":"ac2b98abfb59976b5df3a3c8e3368231064fcdfae2f3da3d851a55e3cdca2fd3"} Jul 09 15:40:34.675137 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:34.675110 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" event={"ID":"9aec5593-67f4-4184-be50-06307cbe2888","Type":"ContainerStarted","Data":"5646b2fb8668820358ac91eacdbf58bf7bfecc9782d8dacbc5b7097a16fbb8e9"} Jul 09 15:40:35.680779 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:35.680736 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" event={"ID":"9aec5593-67f4-4184-be50-06307cbe2888","Type":"ContainerStarted","Data":"66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243"} Jul 09 15:40:35.682173 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:35.682148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" event={"ID":"9e989aba-4d44-4b0f-a2af-90cdddf805a7","Type":"ContainerStarted","Data":"b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9"} Jul 09 15:40:35.682289 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:35.682229 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" podUID="9e989aba-4d44-4b0f-a2af-90cdddf805a7" containerName="authorino" containerID="cri-o://b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9" gracePeriod=30 Jul 09 15:40:35.699284 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:35.699241 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" podStartSLOduration=1.394279012 podStartE2EDuration="1.699226676s" totalImagesPullingTime="304.947664ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:40:35.697912542 +0000 UTC m=+563.985505240" watchObservedRunningTime="2026-07-09 15:40:35.699226676 +0000 UTC m=+563.986819351" Jul 09 15:40:35.714637 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:35.714579 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" podStartSLOduration=2.29295785 podStartE2EDuration="2.714559738s" totalImagesPullingTime="421.601888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:40:35.71338013 +0000 UTC m=+564.000972829" watchObservedRunningTime="2026-07-09 15:40:35.714559738 +0000 UTC m=+564.002152436" Jul 09 15:40:35.740197 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:35.740163 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7btf"] Jul 09 15:40:35.740404 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:35.740376 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-h7btf" podUID="f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472" containerName="authorino" containerID="cri-o://b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672" gracePeriod=30 Jul 09 15:40:36.001329 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.001299 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" Jul 09 15:40:36.010281 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.010256 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7btf" Jul 09 15:40:36.086517 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.086490 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mfxr\" (UniqueName: \"kubernetes.io/projected/f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472-kube-api-access-5mfxr\") pod \"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472\" (UID: \"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472\") " Jul 09 15:40:36.086667 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.086598 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7jtr\" (UniqueName: \"kubernetes.io/projected/9e989aba-4d44-4b0f-a2af-90cdddf805a7-kube-api-access-d7jtr\") pod \"9e989aba-4d44-4b0f-a2af-90cdddf805a7\" (UID: \"9e989aba-4d44-4b0f-a2af-90cdddf805a7\") " Jul 09 15:40:36.088792 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.088759 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472-kube-api-access-5mfxr" (OuterVolumeSpecName: "kube-api-access-5mfxr") pod "f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472" (UID: "f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472"). InnerVolumeSpecName "kube-api-access-5mfxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:40:36.088904 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.088765 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e989aba-4d44-4b0f-a2af-90cdddf805a7-kube-api-access-d7jtr" (OuterVolumeSpecName: "kube-api-access-d7jtr") pod "9e989aba-4d44-4b0f-a2af-90cdddf805a7" (UID: "9e989aba-4d44-4b0f-a2af-90cdddf805a7"). InnerVolumeSpecName "kube-api-access-d7jtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:40:36.187496 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.187407 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mfxr\" (UniqueName: \"kubernetes.io/projected/f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472-kube-api-access-5mfxr\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:40:36.187496 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.187439 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7jtr\" (UniqueName: \"kubernetes.io/projected/9e989aba-4d44-4b0f-a2af-90cdddf805a7-kube-api-access-d7jtr\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:40:36.687711 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.687656 2578 generic.go:356] "Generic (PLEG): container finished" podID="9e989aba-4d44-4b0f-a2af-90cdddf805a7" containerID="b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9" exitCode=0 Jul 09 15:40:36.687711 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.687705 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" Jul 09 15:40:36.688253 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.687749 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" event={"ID":"9e989aba-4d44-4b0f-a2af-90cdddf805a7","Type":"ContainerDied","Data":"b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9"} Jul 09 15:40:36.688253 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.687797 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-w8kjm" event={"ID":"9e989aba-4d44-4b0f-a2af-90cdddf805a7","Type":"ContainerDied","Data":"ac2b98abfb59976b5df3a3c8e3368231064fcdfae2f3da3d851a55e3cdca2fd3"} Jul 09 15:40:36.688253 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.687828 2578 scope.go:117] "RemoveContainer" containerID="b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9" Jul 09 15:40:36.689086 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.689064 2578 generic.go:356] "Generic (PLEG): container finished" podID="f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472" containerID="b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672" exitCode=0 Jul 09 15:40:36.689188 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.689096 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-h7btf" Jul 09 15:40:36.689188 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.689153 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7btf" event={"ID":"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472","Type":"ContainerDied","Data":"b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672"} Jul 09 15:40:36.689299 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.689191 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-h7btf" event={"ID":"f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472","Type":"ContainerDied","Data":"781e8fa7a8d066d011ead2a7ba8337d3d1463415d835dbedb9708a8aae846df8"} Jul 09 15:40:36.696139 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.696122 2578 scope.go:117] "RemoveContainer" containerID="b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9" Jul 09 15:40:36.696413 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:40:36.696389 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9\": container with ID starting with b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9 not found: ID does not exist" containerID="b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9" Jul 09 15:40:36.696477 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.696421 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9"} err="failed to get container status \"b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9\": rpc error: code = NotFound desc = could not find container \"b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9\": container with ID starting with b1d5addbe40053537f77f57a8fe895ebe2d4580198435331bda5e2eeac3873d9 not found: ID does not exist" Jul 09 15:40:36.696477 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.696439 2578 scope.go:117] "RemoveContainer" containerID="b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672" Jul 09 15:40:36.703874 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.703859 2578 scope.go:117] "RemoveContainer" containerID="b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672" Jul 09 15:40:36.704116 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:40:36.704101 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672\": container with ID starting with b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672 not found: ID does not exist" containerID="b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672" Jul 09 15:40:36.704152 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.704126 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672"} err="failed to get container status \"b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672\": rpc error: code = NotFound desc = could not find container \"b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672\": container with ID starting with b86ac071213146797c15d12e0fb1033797a771c922838e2a022c71ef8942d672 not found: ID does not exist" Jul 09 15:40:36.708509 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.708487 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7btf"] Jul 09 15:40:36.713151 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.713131 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-h7btf"] Jul 09 15:40:36.731727 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.731680 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w8kjm"] Jul 09 15:40:36.735062 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:36.735042 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-w8kjm"] Jul 09 15:40:38.390767 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:38.390730 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e989aba-4d44-4b0f-a2af-90cdddf805a7" path="/var/lib/kubelet/pods/9e989aba-4d44-4b0f-a2af-90cdddf805a7/volumes" Jul 09 15:40:38.391255 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:38.391206 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472" path="/var/lib/kubelet/pods/f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472/volumes" Jul 09 15:40:40.284108 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:40.284077 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:41.214377 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:41.214342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:41.313343 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:41.313305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:44.769777 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:44.769739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:40:44.866534 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:40:44.866503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:02.722960 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:02.722924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:12.152868 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:12.152827 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:41:12.156408 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:12.156386 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:41:12.160414 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:12.160386 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:41:12.164008 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:12.163985 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:41:17.758547 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:17.758493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:20.836120 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:20.836086 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:28.489925 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:28.489887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:28.589955 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:28.589920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:33.170159 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:33.170120 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:38.153609 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:38.153568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:43.925835 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:41:43.925788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:00.094744 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:00.094682 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:03.391583 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:03.391539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:15.650408 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.650371 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45"] Jul 09 15:42:15.650893 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.650656 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e989aba-4d44-4b0f-a2af-90cdddf805a7" containerName="authorino" Jul 09 15:42:15.650893 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.650667 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e989aba-4d44-4b0f-a2af-90cdddf805a7" containerName="authorino" Jul 09 15:42:15.650893 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.650683 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472" containerName="authorino" Jul 09 15:42:15.650893 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.650704 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472" containerName="authorino" Jul 09 15:42:15.650893 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.650768 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e989aba-4d44-4b0f-a2af-90cdddf805a7" containerName="authorino" Jul 09 15:42:15.650893 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.650776 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f84b6d99-b176-4a9c-8fd3-6b9e1a8fb472" containerName="authorino" Jul 09 15:42:15.653557 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.653540 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.657642 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.657619 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 15:42:15.657818 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.657730 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 15:42:15.657818 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.657735 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 15:42:15.658085 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.658068 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4b87c\"" Jul 09 15:42:15.672993 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.672964 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45"] Jul 09 15:42:15.714523 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.714482 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:15.734444 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.734412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.734729 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.734450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.734729 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.734475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5444a4a-e370-4ae3-99cc-7a340783cc50-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.734729 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.734538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.734729 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.734571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.734729 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.734593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvsz5\" (UniqueName: \"kubernetes.io/projected/b5444a4a-e370-4ae3-99cc-7a340783cc50-kube-api-access-hvsz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835171 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835137 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5444a4a-e370-4ae3-99cc-7a340783cc50-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835327 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835327 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835327 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvsz5\" (UniqueName: \"kubernetes.io/projected/b5444a4a-e370-4ae3-99cc-7a340783cc50-kube-api-access-hvsz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835327 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835262 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835327 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835733 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835681 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835849 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835750 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.835849 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.835792 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.837913 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.837895 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b5444a4a-e370-4ae3-99cc-7a340783cc50-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.838466 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.838450 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b5444a4a-e370-4ae3-99cc-7a340783cc50-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.846525 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.846503 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvsz5\" (UniqueName: \"kubernetes.io/projected/b5444a4a-e370-4ae3-99cc-7a340783cc50-kube-api-access-hvsz5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45\" (UID: \"b5444a4a-e370-4ae3-99cc-7a340783cc50\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:15.965721 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:15.965606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:16.117763 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:16.117623 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45"] Jul 09 15:42:16.120352 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:42:16.120325 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5444a4a_e370_4ae3_99cc_7a340783cc50.slice/crio-1d4f3a30c9cb7d276caf387dde94d1a596be74fb3a50bf6689b9551b83776f76 WatchSource:0}: Error finding container 1d4f3a30c9cb7d276caf387dde94d1a596be74fb3a50bf6689b9551b83776f76: Status 404 returned error can't find the container with id 1d4f3a30c9cb7d276caf387dde94d1a596be74fb3a50bf6689b9551b83776f76 Jul 09 15:42:16.121809 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:16.121793 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:42:17.125238 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:17.125193 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" event={"ID":"b5444a4a-e370-4ae3-99cc-7a340783cc50","Type":"ContainerStarted","Data":"1d4f3a30c9cb7d276caf387dde94d1a596be74fb3a50bf6689b9551b83776f76"} Jul 09 15:42:18.131763 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:18.131717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" event={"ID":"b5444a4a-e370-4ae3-99cc-7a340783cc50","Type":"ContainerStarted","Data":"c4e98960709a82f747507ef6a46fea1695f3c2fd79043c2326dc63b2893e893c"} Jul 09 15:42:25.965968 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:25.965925 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:25.966403 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:25.965990 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:25.978543 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:25.978514 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:26.005717 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.005645 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" podStartSLOduration=9.92414013 podStartE2EDuration="11.005625843s" totalImagesPullingTime="1.081485713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:42:18.158429983 +0000 UTC m=+666.446022690" watchObservedRunningTime="2026-07-09 15:42:26.005625843 +0000 UTC m=+674.293218539" Jul 09 15:42:26.177580 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.177544 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45" Jul 09 15:42:26.819823 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.819781 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd"] Jul 09 15:42:26.823135 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.823117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:26.828338 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.828315 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 15:42:26.837853 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.837821 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd"] Jul 09 15:42:26.841981 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.841953 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:26.931331 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.931292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:26.931491 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.931338 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:26.931491 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.931409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:26.931491 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.931450 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:26.931615 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.931509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4492cbb-fc76-4b40-af53-5d27ca162e5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:26.931615 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:26.931530 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72z2g\" (UniqueName: \"kubernetes.io/projected/a4492cbb-fc76-4b40-af53-5d27ca162e5c-kube-api-access-72z2g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.032771 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.032713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.032771 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.032786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.033328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.032810 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.033328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.032865 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4492cbb-fc76-4b40-af53-5d27ca162e5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.033328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.032986 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72z2g\" (UniqueName: \"kubernetes.io/projected/a4492cbb-fc76-4b40-af53-5d27ca162e5c-kube-api-access-72z2g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.033328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.033047 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.033328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.033272 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.033328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.033297 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.033550 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.033364 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.035114 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.035083 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4492cbb-fc76-4b40-af53-5d27ca162e5c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.035338 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.035321 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4492cbb-fc76-4b40-af53-5d27ca162e5c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.046284 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.046258 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72z2g\" (UniqueName: \"kubernetes.io/projected/a4492cbb-fc76-4b40-af53-5d27ca162e5c-kube-api-access-72z2g\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-tnmxd\" (UID: \"a4492cbb-fc76-4b40-af53-5d27ca162e5c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.133938 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.133834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:27.269903 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:27.269879 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd"] Jul 09 15:42:27.273846 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:42:27.273820 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4492cbb_fc76_4b40_af53_5d27ca162e5c.slice/crio-79c752e39e9bf56e5ba986f75656f48c5efbe4f44a0d80bff68089851c24f07e WatchSource:0}: Error finding container 79c752e39e9bf56e5ba986f75656f48c5efbe4f44a0d80bff68089851c24f07e: Status 404 returned error can't find the container with id 79c752e39e9bf56e5ba986f75656f48c5efbe4f44a0d80bff68089851c24f07e Jul 09 15:42:28.176390 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:28.176351 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" event={"ID":"a4492cbb-fc76-4b40-af53-5d27ca162e5c","Type":"ContainerStarted","Data":"c4081344c07faa0cb041f5a222a780e8a258a88e46d1a0053faf3d88d6dd91ae"} Jul 09 15:42:28.176876 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:28.176406 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" event={"ID":"a4492cbb-fc76-4b40-af53-5d27ca162e5c","Type":"ContainerStarted","Data":"79c752e39e9bf56e5ba986f75656f48c5efbe4f44a0d80bff68089851c24f07e"} Jul 09 15:42:28.197626 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:28.197566 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" podStartSLOduration=1.980877881 podStartE2EDuration="2.197543961s" totalImagesPullingTime="216.66608ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:42:28.197221736 +0000 UTC m=+676.484814460" watchObservedRunningTime="2026-07-09 15:42:28.197543961 +0000 UTC m=+676.485136660" Jul 09 15:42:33.151315 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:33.151282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:33.250476 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:33.250432 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:34.910455 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:34.910416 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:37.134095 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:37.134053 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:37.134571 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:37.134132 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:37.146904 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:37.146869 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:37.225764 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:37.225718 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-tnmxd" Jul 09 15:42:40.216955 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:40.216923 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:45.794985 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:45.794948 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:57.158928 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:42:57.158889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:43:35.598112 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:35.598072 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:43:35.653094 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:35.653059 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:43:59.095037 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.094999 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d5489b7d5-q5hws"] Jul 09 15:43:59.098272 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.098251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.106993 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.106967 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d5489b7d5-q5hws"] Jul 09 15:43:59.127951 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.127917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk54t\" (UniqueName: \"kubernetes.io/projected/46537406-b272-4569-b7b1-ea88b825f01a-kube-api-access-nk54t\") pod \"authorino-d5489b7d5-q5hws\" (UID: \"46537406-b272-4569-b7b1-ea88b825f01a\") " pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.128121 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.127963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46537406-b272-4569-b7b1-ea88b825f01a-tls-cert\") pod \"authorino-d5489b7d5-q5hws\" (UID: \"46537406-b272-4569-b7b1-ea88b825f01a\") " pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.229176 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.229136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk54t\" (UniqueName: \"kubernetes.io/projected/46537406-b272-4569-b7b1-ea88b825f01a-kube-api-access-nk54t\") pod \"authorino-d5489b7d5-q5hws\" (UID: \"46537406-b272-4569-b7b1-ea88b825f01a\") " pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.229342 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.229188 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46537406-b272-4569-b7b1-ea88b825f01a-tls-cert\") pod \"authorino-d5489b7d5-q5hws\" (UID: \"46537406-b272-4569-b7b1-ea88b825f01a\") " pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.231655 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.231635 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/46537406-b272-4569-b7b1-ea88b825f01a-tls-cert\") pod \"authorino-d5489b7d5-q5hws\" (UID: \"46537406-b272-4569-b7b1-ea88b825f01a\") " pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.239914 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.239885 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk54t\" (UniqueName: \"kubernetes.io/projected/46537406-b272-4569-b7b1-ea88b825f01a-kube-api-access-nk54t\") pod \"authorino-d5489b7d5-q5hws\" (UID: \"46537406-b272-4569-b7b1-ea88b825f01a\") " pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.407428 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.407344 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d5489b7d5-q5hws" Jul 09 15:43:59.442352 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.442317 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:43:59.540802 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.540769 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:43:59.553014 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.552983 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d5489b7d5-q5hws"] Jul 09 15:43:59.555995 ip-10-0-128-112 kubenswrapper[2578]: W0709 15:43:59.555964 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46537406_b272_4569_b7b1_ea88b825f01a.slice/crio-80695f66f30e54ceaf18d1fb938188fae8c95d000264c49d7db5ec1d44285b10 WatchSource:0}: Error finding container 80695f66f30e54ceaf18d1fb938188fae8c95d000264c49d7db5ec1d44285b10: Status 404 returned error can't find the container with id 80695f66f30e54ceaf18d1fb938188fae8c95d000264c49d7db5ec1d44285b10 Jul 09 15:43:59.563857 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:43:59.563831 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d5489b7d5-q5hws" event={"ID":"46537406-b272-4569-b7b1-ea88b825f01a","Type":"ContainerStarted","Data":"80695f66f30e54ceaf18d1fb938188fae8c95d000264c49d7db5ec1d44285b10"} Jul 09 15:44:00.571054 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.571017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d5489b7d5-q5hws" event={"ID":"46537406-b272-4569-b7b1-ea88b825f01a","Type":"ContainerStarted","Data":"1ae399922c406cce0bf3e0c90f84ab9137e0897b134f4d09704055ea9edf4541"} Jul 09 15:44:00.598022 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.597966 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d5489b7d5-q5hws" podStartSLOduration=1.169543078 podStartE2EDuration="1.597947362s" totalImagesPullingTime="428.404284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:44:00.597167289 +0000 UTC m=+768.884759987" watchObservedRunningTime="2026-07-09 15:44:00.597947362 +0000 UTC m=+768.885540059" Jul 09 15:44:00.635572 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.635536 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c5747ff48-dl9x6"] Jul 09 15:44:00.635794 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.635766 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" podUID="9aec5593-67f4-4184-be50-06307cbe2888" containerName="authorino" containerID="cri-o://66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243" gracePeriod=30 Jul 09 15:44:00.672721 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.672644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:44:00.760078 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.760042 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:44:00.895834 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.895809 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:44:00.943269 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.943239 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9aec5593-67f4-4184-be50-06307cbe2888-tls-cert\") pod \"9aec5593-67f4-4184-be50-06307cbe2888\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " Jul 09 15:44:00.943456 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.943308 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2z2n\" (UniqueName: \"kubernetes.io/projected/9aec5593-67f4-4184-be50-06307cbe2888-kube-api-access-k2z2n\") pod \"9aec5593-67f4-4184-be50-06307cbe2888\" (UID: \"9aec5593-67f4-4184-be50-06307cbe2888\") " Jul 09 15:44:00.945513 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.945483 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9aec5593-67f4-4184-be50-06307cbe2888-kube-api-access-k2z2n" (OuterVolumeSpecName: "kube-api-access-k2z2n") pod "9aec5593-67f4-4184-be50-06307cbe2888" (UID: "9aec5593-67f4-4184-be50-06307cbe2888"). InnerVolumeSpecName "kube-api-access-k2z2n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:44:00.954193 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:00.954159 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9aec5593-67f4-4184-be50-06307cbe2888-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9aec5593-67f4-4184-be50-06307cbe2888" (UID: "9aec5593-67f4-4184-be50-06307cbe2888"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:44:01.044103 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.044061 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9aec5593-67f4-4184-be50-06307cbe2888-tls-cert\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:44:01.044103 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.044101 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2z2n\" (UniqueName: \"kubernetes.io/projected/9aec5593-67f4-4184-be50-06307cbe2888-kube-api-access-k2z2n\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 15:44:01.578028 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.577989 2578 generic.go:356] "Generic (PLEG): container finished" podID="9aec5593-67f4-4184-be50-06307cbe2888" containerID="66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243" exitCode=0 Jul 09 15:44:01.578460 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.578071 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" Jul 09 15:44:01.578460 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.578078 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" event={"ID":"9aec5593-67f4-4184-be50-06307cbe2888","Type":"ContainerDied","Data":"66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243"} Jul 09 15:44:01.578460 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.578126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c5747ff48-dl9x6" event={"ID":"9aec5593-67f4-4184-be50-06307cbe2888","Type":"ContainerDied","Data":"5646b2fb8668820358ac91eacdbf58bf7bfecc9782d8dacbc5b7097a16fbb8e9"} Jul 09 15:44:01.578460 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.578147 2578 scope.go:117] "RemoveContainer" containerID="66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243" Jul 09 15:44:01.586605 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.586579 2578 scope.go:117] "RemoveContainer" containerID="66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243" Jul 09 15:44:01.586905 ip-10-0-128-112 kubenswrapper[2578]: E0709 15:44:01.586882 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243\": container with ID starting with 66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243 not found: ID does not exist" containerID="66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243" Jul 09 15:44:01.586959 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.586915 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243"} err="failed to get container status \"66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243\": rpc error: code = NotFound desc = could not find container \"66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243\": container with ID starting with 66f4930772396e03c634d9e50e97e7498a19e36bf3727933b5436c9b28c00243 not found: ID does not exist" Jul 09 15:44:01.603154 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.603125 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c5747ff48-dl9x6"] Jul 09 15:44:01.608615 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:01.608587 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c5747ff48-dl9x6"] Jul 09 15:44:02.390206 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:44:02.390173 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9aec5593-67f4-4184-be50-06307cbe2888" path="/var/lib/kubelet/pods/9aec5593-67f4-4184-be50-06307cbe2888/volumes" Jul 09 15:45:12.666908 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:45:12.666871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:45:14.253743 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:45:14.253705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:45:54.110768 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:45:54.110730 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:45:54.208499 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:45:54.208448 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:45:54.347706 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:45:54.347642 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:00.854522 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:00.854483 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:00.914287 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:00.914256 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:00.991296 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:00.991263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:01.090906 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:01.090874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:01.233951 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:01.233858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:01.506910 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:01.506807 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:07.358618 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:07.358531 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:07.462125 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:07.462086 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:12.187721 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:12.187675 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:46:12.190990 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:12.190956 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:46:12.191600 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:12.191582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:46:12.194841 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:12.194822 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:46:25.606146 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:25.606104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:46:27.618214 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:46:27.618179 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:48:59.436294 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:48:59.436262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:48:59.645486 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:48:59.645439 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:11.101595 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:50:11.101553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:51:12.214990 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:51:12.214962 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:51:12.216508 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:51:12.216485 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:51:12.218099 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:51:12.218080 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:51:12.222306 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:51:12.222287 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:53:13.438636 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:53:13.438598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:54:09.612305 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:54:09.612212 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:56:01.097150 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:56:01.097105 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:56:01.184720 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:56:01.184648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:56:12.244974 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:56:12.244940 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:56:12.245547 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:56:12.245055 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 15:56:12.248489 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:56:12.248469 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:56:12.248842 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:56:12.248824 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 15:56:57.137841 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:56:57.137734 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:02.710076 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:02.710018 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:10.996008 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:10.995966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:16.145318 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:16.145285 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:19.181133 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:19.181089 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:19.281209 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:19.281175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:19.676378 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:19.676346 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:25.840557 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:25.840490 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:25.905528 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:25.905491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:26.088623 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:26.088583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:26.189090 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:26.188973 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:27.171257 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:27.171213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:27.244679 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:27.244623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:27.313958 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:27.313913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:27.378679 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:27.378639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:27.862911 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:27.862873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:27.964803 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:27.964761 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:29.648009 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:29.647979 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:32.356658 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:32.356623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:32.566469 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:32.566435 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:32.681191 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:32.681092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:32.802130 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:32.802095 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:34.035589 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:34.035555 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:38.961735 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:38.961649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:39.063915 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:39.063882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:39.179594 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:39.179561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:40.538748 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:40.538716 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:40.638595 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:40.638562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:40.816222 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:40.816194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:41.013749 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:41.013712 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:41.112991 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:41.112910 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:42.140539 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:42.140499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:45.488919 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:45.488882 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:45.897066 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:45.897033 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:51.614765 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:51.614727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:51.734750 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:51.734723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:58.005418 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:58.005375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:58.120526 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:58.120493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:58.220511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:58.220468 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:59.021163 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:59.021129 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:59.119362 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:59.119319 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:59.345904 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:59.345858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:59.428055 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:59.428008 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:59.491145 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:59.491111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:59.826649 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:59.826611 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:57:59.928420 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:57:59.928378 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:00.027499 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:00.027466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:02.847820 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:02.847780 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:03.802511 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:03.802411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:04.051061 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:04.051025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:04.163405 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:04.163296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:04.254672 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:04.254623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:05.542819 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:05.542786 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:10.822712 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:10.822650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:10.877377 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:10.877346 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:11.304998 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:11.304966 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:11.406027 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:11.405987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:11.504494 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:11.504463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:12.938021 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:12.937989 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:18.971954 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:18.971919 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:21.008827 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:21.008791 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:45.690841 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:45.690799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:51.858256 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:51.858218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:51.914285 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:51.914249 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:52.090758 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:52.090717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:58:52.190981 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:58:52.190897 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:00.399328 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:00.399293 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:07.980226 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:07.980191 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:15.261888 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:15.261848 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:15.322493 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:15.322460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:22.151848 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:22.151800 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:22.253403 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:22.253366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:24.773778 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:24.773735 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:25.589561 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:25.589523 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:31.647151 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:31.647111 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:31.751594 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:31.751560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:31.849119 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:31.849084 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:31.949384 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:31.949305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:32.725388 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:32.725352 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:32.842903 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:32.842867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:32.943580 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:32.943539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:34.566146 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:34.566032 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:40.842594 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:40.842549 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:40.941866 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:40.941814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:41.544200 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:41.544167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:47.575509 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:47.575461 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:47.631975 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:47.631936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:47.824065 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:47.824016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:48.125702 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:48.125643 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:48.330729 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:48.330673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:51.371422 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:51.371385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:51.471041 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:51.471010 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:51.667343 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:51.667254 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:52.093469 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:52.093434 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:53.640100 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:53.640062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:55.900039 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:55.900003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:56.583295 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:56.583262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:56.683652 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:56.683613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 15:59:57.035509 ip-10-0-128-112 kubenswrapper[2578]: I0709 15:59:57.035413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:03.340740 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:03.340684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:03.441948 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:03.441909 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:03.955245 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:03.955212 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:05.791842 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:05.791804 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:05.892306 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:05.892272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:10.852852 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:10.852816 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:10.952927 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:10.952887 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:11.068247 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:11.068206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:17.506720 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:17.506647 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:17.562578 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:17.562543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:17.631840 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:17.631805 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:19.673057 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:19.673019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:19.731155 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:19.731118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:23.886848 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:23.886818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:24.616590 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:24.616553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:30.881464 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:30.881417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:31.201343 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:31.201220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:31.539389 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:31.539291 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:34.676174 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:34.676128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:34.779017 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:34.778981 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:35.041345 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:35.041260 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:35.142250 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:35.142219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:35.355062 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:35.355030 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:35.456558 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:35.456524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:36.246746 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:36.246684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:36.348187 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:36.348156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:37.014274 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:37.014244 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:37.115064 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:37.115034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:39.194267 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:39.194233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:58.390065 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.389990 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4"] Jul 09 16:00:58.390543 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.390297 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9aec5593-67f4-4184-be50-06307cbe2888" containerName="authorino" Jul 09 16:00:58.390543 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.390310 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9aec5593-67f4-4184-be50-06307cbe2888" containerName="authorino" Jul 09 16:00:58.390543 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.390382 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9aec5593-67f4-4184-be50-06307cbe2888" containerName="authorino" Jul 09 16:00:58.397756 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.397728 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4"] Jul 09 16:00:58.397886 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.397842 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.400455 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.400433 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-378f7a5c\"/\"kube-root-ca.crt\"" Jul 09 16:00:58.401476 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.401456 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-378f7a5c\"/\"openshift-service-ca.crt\"" Jul 09 16:00:58.401604 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.401490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-378f7a5c\"/\"default-dockercfg-wfl8v\"" Jul 09 16:00:58.401795 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.401770 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-378f7a5c\"/\"e2e-lifecycle-model-378f7a5c-kserve-self-signed-certs\"" Jul 09 16:00:58.418881 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.418851 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:00:58.460224 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.460187 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tmp-dir\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.460387 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.460231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl57f\" (UniqueName: \"kubernetes.io/projected/3580987a-b4b7-41c8-9c3b-533605aa1bcd-kube-api-access-nl57f\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.460387 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.460257 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-model-cache\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.460387 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.460349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-dshm\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.460387 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.460381 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tls-certs\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.460550 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.460408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-home\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561376 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tmp-dir\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561376 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl57f\" (UniqueName: \"kubernetes.io/projected/3580987a-b4b7-41c8-9c3b-533605aa1bcd-kube-api-access-nl57f\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561633 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-model-cache\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561633 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-dshm\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561633 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tls-certs\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561633 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561470 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-home\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561854 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561830 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tmp-dir\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561892 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561865 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-model-cache\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.561926 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.561901 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-home\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.563724 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.563666 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-dshm\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.563976 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.563958 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tls-certs\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.571357 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.571331 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl57f\" (UniqueName: \"kubernetes.io/projected/3580987a-b4b7-41c8-9c3b-533605aa1bcd-kube-api-access-nl57f\") pod \"e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.707391 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.707293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:00:58.843056 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:58.843032 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4"] Jul 09 16:00:58.845062 ip-10-0-128-112 kubenswrapper[2578]: W0709 16:00:58.845038 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3580987a_b4b7_41c8_9c3b_533605aa1bcd.slice/crio-b6c50193f703a03c563ec997c9531987ddf191af15497ef4d629a766f3d95335 WatchSource:0}: Error finding container b6c50193f703a03c563ec997c9531987ddf191af15497ef4d629a766f3d95335: Status 404 returned error can't find the container with id b6c50193f703a03c563ec997c9531987ddf191af15497ef4d629a766f3d95335 Jul 09 16:00:59.062427 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:59.062386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" event={"ID":"3580987a-b4b7-41c8-9c3b-533605aa1bcd","Type":"ContainerStarted","Data":"a1990e421140a7b426686a330784290dc2d63f58eff161ae2843f6c78bb9cbf7"} Jul 09 16:00:59.062608 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:59.062437 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" event={"ID":"3580987a-b4b7-41c8-9c3b-533605aa1bcd","Type":"ContainerStarted","Data":"b6c50193f703a03c563ec997c9531987ddf191af15497ef4d629a766f3d95335"} Jul 09 16:00:59.082470 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:00:59.082418 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" podStartSLOduration=1.082399211 podStartE2EDuration="1.082399211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:00:59.0811878 +0000 UTC m=+1787.368780498" watchObservedRunningTime="2026-07-09 16:00:59.082399211 +0000 UTC m=+1787.369991908" Jul 09 16:01:08.708162 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:08.708085 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:01:08.708162 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:08.708128 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:01:08.720710 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:08.720660 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:01:09.116701 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:09.116652 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:01:12.278501 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:12.278462 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 16:01:12.278969 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:12.278798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 16:01:12.281726 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:12.281682 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 16:01:12.282022 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:12.282005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 16:01:22.007793 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:22.007760 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:01:22.333550 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:22.333508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:01:28.167346 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:28.167305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:01:33.137623 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:33.137582 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4"] Jul 09 16:01:33.183906 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:33.183873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:01:48.157999 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.157937 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" podUID="3580987a-b4b7-41c8-9c3b-533605aa1bcd" containerName="main" containerID="cri-o://a1990e421140a7b426686a330784290dc2d63f58eff161ae2843f6c78bb9cbf7" gracePeriod=45 Jul 09 16:01:48.281313 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.281283 2578 generic.go:356] "Generic (PLEG): container finished" podID="3580987a-b4b7-41c8-9c3b-533605aa1bcd" containerID="a1990e421140a7b426686a330784290dc2d63f58eff161ae2843f6c78bb9cbf7" exitCode=0 Jul 09 16:01:48.281470 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.281323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" event={"ID":"3580987a-b4b7-41c8-9c3b-533605aa1bcd","Type":"ContainerDied","Data":"a1990e421140a7b426686a330784290dc2d63f58eff161ae2843f6c78bb9cbf7"} Jul 09 16:01:48.406913 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.406885 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:01:48.499646 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.499543 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tls-certs\") pod \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " Jul 09 16:01:48.499646 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.499603 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-home\") pod \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " Jul 09 16:01:48.499646 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.499625 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tmp-dir\") pod \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " Jul 09 16:01:48.499954 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.499652 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl57f\" (UniqueName: \"kubernetes.io/projected/3580987a-b4b7-41c8-9c3b-533605aa1bcd-kube-api-access-nl57f\") pod \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " Jul 09 16:01:48.499954 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.499679 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-model-cache\") pod \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " Jul 09 16:01:48.499954 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.499742 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-dshm\") pod \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\" (UID: \"3580987a-b4b7-41c8-9c3b-533605aa1bcd\") " Jul 09 16:01:48.500114 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.499959 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3580987a-b4b7-41c8-9c3b-533605aa1bcd" (UID: "3580987a-b4b7-41c8-9c3b-533605aa1bcd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:01:48.500114 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.500005 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-home" (OuterVolumeSpecName: "home") pod "3580987a-b4b7-41c8-9c3b-533605aa1bcd" (UID: "3580987a-b4b7-41c8-9c3b-533605aa1bcd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:01:48.500114 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.500023 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-model-cache" (OuterVolumeSpecName: "model-cache") pod "3580987a-b4b7-41c8-9c3b-533605aa1bcd" (UID: "3580987a-b4b7-41c8-9c3b-533605aa1bcd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:01:48.500278 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.500142 2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-home\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:01:48.500278 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.500160 2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tmp-dir\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:01:48.500278 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.500174 2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-model-cache\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:01:48.502038 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.502008 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-dshm" (OuterVolumeSpecName: "dshm") pod "3580987a-b4b7-41c8-9c3b-533605aa1bcd" (UID: "3580987a-b4b7-41c8-9c3b-533605aa1bcd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:01:48.502305 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.502290 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3580987a-b4b7-41c8-9c3b-533605aa1bcd-kube-api-access-nl57f" (OuterVolumeSpecName: "kube-api-access-nl57f") pod "3580987a-b4b7-41c8-9c3b-533605aa1bcd" (UID: "3580987a-b4b7-41c8-9c3b-533605aa1bcd"). InnerVolumeSpecName "kube-api-access-nl57f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:01:48.502363 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.502297 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3580987a-b4b7-41c8-9c3b-533605aa1bcd" (UID: "3580987a-b4b7-41c8-9c3b-533605aa1bcd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:01:48.600903 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.600863 2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3580987a-b4b7-41c8-9c3b-533605aa1bcd-tls-certs\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:01:48.600903 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.600897 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl57f\" (UniqueName: \"kubernetes.io/projected/3580987a-b4b7-41c8-9c3b-533605aa1bcd-kube-api-access-nl57f\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:01:48.600903 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:48.600907 2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3580987a-b4b7-41c8-9c3b-533605aa1bcd-dshm\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:01:49.288030 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:49.288006 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" Jul 09 16:01:49.288464 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:49.288003 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4" event={"ID":"3580987a-b4b7-41c8-9c3b-533605aa1bcd","Type":"ContainerDied","Data":"b6c50193f703a03c563ec997c9531987ddf191af15497ef4d629a766f3d95335"} Jul 09 16:01:49.288464 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:49.288125 2578 scope.go:117] "RemoveContainer" containerID="a1990e421140a7b426686a330784290dc2d63f58eff161ae2843f6c78bb9cbf7" Jul 09 16:01:49.309965 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:49.309942 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4"] Jul 09 16:01:49.316863 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:49.316840 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-378f7a5c/e2e-lifecycle-model-378f7a5c-kserve-8d96f748c-glsq4"] Jul 09 16:01:50.391206 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:01:50.391174 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3580987a-b4b7-41c8-9c3b-533605aa1bcd" path="/var/lib/kubelet/pods/3580987a-b4b7-41c8-9c3b-533605aa1bcd/volumes" Jul 09 16:02:09.639405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:09.639366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:10.853590 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:10.853555 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:17.003812 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:17.003774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:17.104819 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:17.104778 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:17.311978 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:17.311943 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:18.711359 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:18.711324 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:19.690284 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:19.690255 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:19.790726 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:19.790673 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:19.886839 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:19.886806 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:19.989726 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:19.989633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:21.457877 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:21.457838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:28.352462 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:28.352423 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:28.457336 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:28.457296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:29.083631 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:29.083595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:35.124786 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:35.124703 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:35.227468 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:35.227430 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:35.325171 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:35.325139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:45.901450 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:45.901407 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:02:46.293981 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:02:46.293894 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:07.309230 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:07.309194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:13.268563 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:13.268525 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:13.369770 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:13.369739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:13.728314 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:13.728282 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:13.828668 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:13.828638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:14.117737 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:14.117675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:14.429560 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:14.429471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:14.606723 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:14.606679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:17.587537 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:17.587499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:17.684944 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:17.684892 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:17.866343 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:17.866257 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:18.279216 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:18.279116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:18.470828 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:18.470781 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:18.574009 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:18.573974 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:22.110234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.110196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:22.799553 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.799515 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f"] Jul 09 16:03:22.799991 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.799970 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3580987a-b4b7-41c8-9c3b-533605aa1bcd" containerName="main" Jul 09 16:03:22.799991 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.799993 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3580987a-b4b7-41c8-9c3b-533605aa1bcd" containerName="main" Jul 09 16:03:22.800186 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.800087 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3580987a-b4b7-41c8-9c3b-533605aa1bcd" containerName="main" Jul 09 16:03:22.803142 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.803117 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.805523 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.805502 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2ca941-openshift-default-dockercfg-c5p9f\"" Jul 09 16:03:22.819414 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-token\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819517 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-data\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819517 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-socket\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819517 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819512 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-envoy\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819764 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istiod-ca-cert\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819764 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819572 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-credential-socket\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819764 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-kube-api-access-tsmwb\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819764 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-certs\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.819764 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.819750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-podinfo\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.821880 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.821839 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f"] Jul 09 16:03:22.920305 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-token\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-data\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-socket\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920374 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-envoy\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920401 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istiod-ca-cert\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920425 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-credential-socket\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920454 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-kube-api-access-tsmwb\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920477 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-certs\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920519 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920501 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-podinfo\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920988 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920905 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-data\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.920988 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.920976 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-socket\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.921536 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.921504 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-certs\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.921661 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.921568 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-credential-socket\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.921892 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.921871 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istiod-ca-cert\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.928284 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.928256 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-envoy\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.929032 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.928998 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-podinfo\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.930167 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.930147 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-token\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:22.930938 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:22.930919 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-kube-api-access-tsmwb\") pod \"e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:23.113332 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.113246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:23.250763 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.250741 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f"] Jul 09 16:03:23.253188 ip-10-0-128-112 kubenswrapper[2578]: W0709 16:03:23.253156 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce80ab9_b2e4_4436_95fd_3d81d8998de2.slice/crio-1b103d34dadb6428e453840240353b6a26b965d3a848add1c440bfeedd12e483 WatchSource:0}: Error finding container 1b103d34dadb6428e453840240353b6a26b965d3a848add1c440bfeedd12e483: Status 404 returned error can't find the container with id 1b103d34dadb6428e453840240353b6a26b965d3a848add1c440bfeedd12e483 Jul 09 16:03:23.255458 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.255428 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:03:23.255518 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.255495 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:03:23.255554 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.255522 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:03:23.701650 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.701616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" event={"ID":"8ce80ab9-b2e4-4436-95fd-3d81d8998de2","Type":"ContainerStarted","Data":"d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9"} Jul 09 16:03:23.701862 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.701671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" event={"ID":"8ce80ab9-b2e4-4436-95fd-3d81d8998de2","Type":"ContainerStarted","Data":"1b103d34dadb6428e453840240353b6a26b965d3a848add1c440bfeedd12e483"} Jul 09 16:03:23.728655 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.728604 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" podStartSLOduration=1.728588556 podStartE2EDuration="1.728588556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:03:23.726215328 +0000 UTC m=+1932.013808039" watchObservedRunningTime="2026-07-09 16:03:23.728588556 +0000 UTC m=+1932.016181253" Jul 09 16:03:23.932122 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:23.932086 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:24.113935 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:24.113905 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:24.118476 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:24.118452 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:24.706446 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:24.706419 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:24.707482 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:24.707460 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:25.726209 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:25.726170 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:25.801034 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:25.801002 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:25.864891 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:25.864854 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:25.967927 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:25.967885 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:26.338436 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:26.338400 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:26.437742 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:26.437684 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:30.270389 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:30.270351 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:36.815142 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:36.815101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:40.122487 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:40.122450 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:40.220677 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:40.220639 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:40.748912 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:40.748865 2578 patch_prober.go:28] interesting pod/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 16:03:40.749109 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:40.748941 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 16:03:41.783210 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:41.783125 2578 generic.go:356] "Generic (PLEG): container finished" podID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerID="d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9" exitCode=0 Jul 09 16:03:41.783210 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:41.783165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" event={"ID":"8ce80ab9-b2e4-4436-95fd-3d81d8998de2","Type":"ContainerDied","Data":"d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9"} Jul 09 16:03:41.783658 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:41.783532 2578 scope.go:117] "RemoveContainer" containerID="d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9" Jul 09 16:03:41.784491 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:41.784464 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:03:41.784541 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:41.784533 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:03:41.784582 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:41.784566 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:03:42.789158 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:42.789126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" event={"ID":"8ce80ab9-b2e4-4436-95fd-3d81d8998de2","Type":"ContainerStarted","Data":"cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db"} Jul 09 16:03:43.114339 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:43.114296 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:43.114602 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:43.114575 2578 patch_prober.go:28] interesting pod/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 16:03:43.114713 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:43.114635 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 16:03:44.114141 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:44.114105 2578 patch_prober.go:28] interesting pod/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 16:03:44.114573 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:44.114177 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 16:03:45.114496 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:45.114458 2578 patch_prober.go:28] interesting pod/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 16:03:45.114939 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:45.114518 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 16:03:46.114567 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:46.114527 2578 patch_prober.go:28] interesting pod/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 09 16:03:46.115009 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:46.114601 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 09 16:03:47.117730 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:47.117675 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:47.118185 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:47.118173 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:47.118870 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:47.118853 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:03:47.731492 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:47.731456 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:03:47.817998 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:03:47.817952 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:06.721484 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.721398 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2"] Jul 09 16:04:06.724848 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.724829 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.730908 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.730885 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2ca941\"/\"kube-root-ca.crt\"" Jul 09 16:04:06.732092 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.732073 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2ca941\"/\"default-dockercfg-4rvbt\"" Jul 09 16:04:06.732179 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.732143 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2ca941\"/\"test-model-2ca941-kserve-self-signed-certs\"" Jul 09 16:04:06.732626 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.732610 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2ca941\"/\"openshift-service-ca.crt\"" Jul 09 16:04:06.738436 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.738408 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2"] Jul 09 16:04:06.761158 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.761128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:06.818216 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.818181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db221ce5-80aa-4f78-ba0b-fe00b974488d-tls-certs\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.818216 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.818217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-model-cache\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.818423 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.818248 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-home\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.818423 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.818312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-tmp-dir\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.818423 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.818378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-dshm\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.818526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.818437 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96cns\" (UniqueName: \"kubernetes.io/projected/db221ce5-80aa-4f78-ba0b-fe00b974488d-kube-api-access-96cns\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919065 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db221ce5-80aa-4f78-ba0b-fe00b974488d-tls-certs\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919384 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919077 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-model-cache\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919384 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-home\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919384 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-tmp-dir\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919384 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919213 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-dshm\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919384 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919276 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96cns\" (UniqueName: \"kubernetes.io/projected/db221ce5-80aa-4f78-ba0b-fe00b974488d-kube-api-access-96cns\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919951 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919740 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-home\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.919951 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.919846 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-tmp-dir\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.920852 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.920827 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-model-cache\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.923296 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.923274 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-dshm\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.923550 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.923533 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db221ce5-80aa-4f78-ba0b-fe00b974488d-tls-certs\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:06.930481 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:06.930457 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96cns\" (UniqueName: \"kubernetes.io/projected/db221ce5-80aa-4f78-ba0b-fe00b974488d-kube-api-access-96cns\") pod \"test-model-2ca941-kserve-76dd86899c-9nqp2\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:07.034795 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:07.034641 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:07.171780 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:07.171754 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2"] Jul 09 16:04:07.173876 ip-10-0-128-112 kubenswrapper[2578]: W0709 16:04:07.173846 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddb221ce5_80aa_4f78_ba0b_fe00b974488d.slice/crio-211db807e429cec2d054fb84e5cb08f22e2f150097f580bc623a0b6351adda1e WatchSource:0}: Error finding container 211db807e429cec2d054fb84e5cb08f22e2f150097f580bc623a0b6351adda1e: Status 404 returned error can't find the container with id 211db807e429cec2d054fb84e5cb08f22e2f150097f580bc623a0b6351adda1e Jul 09 16:04:07.929707 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:07.929648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" event={"ID":"db221ce5-80aa-4f78-ba0b-fe00b974488d","Type":"ContainerStarted","Data":"c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853"} Jul 09 16:04:07.929707 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:07.929711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" event={"ID":"db221ce5-80aa-4f78-ba0b-fe00b974488d","Type":"ContainerStarted","Data":"211db807e429cec2d054fb84e5cb08f22e2f150097f580bc623a0b6351adda1e"} Jul 09 16:04:07.950005 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:07.949950 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" podStartSLOduration=1.9499313059999999 podStartE2EDuration="1.949931306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:04:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:04:07.948116203 +0000 UTC m=+1976.235708902" watchObservedRunningTime="2026-07-09 16:04:07.949931306 +0000 UTC m=+1976.237524003" Jul 09 16:04:17.035746 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:17.035674 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:17.035746 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:17.035750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:17.048398 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:17.048371 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:17.984526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:17.984490 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:04:33.522028 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:33.521995 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:44.450381 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:44.450346 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:45.410998 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:45.410964 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2"] Jul 09 16:04:45.433436 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:45.433404 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:45.583448 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:45.583413 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:46.034818 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:46.034787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:46.136811 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:46.136777 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:46.236376 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:46.236341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:46.383582 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:46.383538 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:04:51.087336 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:04:51.087297 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:00.431556 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.431509 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" podUID="db221ce5-80aa-4f78-ba0b-fe00b974488d" containerName="main" containerID="cri-o://c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853" gracePeriod=45 Jul 09 16:05:00.687103 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.687036 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:05:00.814938 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.814903 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-dshm\") pod \"db221ce5-80aa-4f78-ba0b-fe00b974488d\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " Jul 09 16:05:00.814938 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.814960 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96cns\" (UniqueName: \"kubernetes.io/projected/db221ce5-80aa-4f78-ba0b-fe00b974488d-kube-api-access-96cns\") pod \"db221ce5-80aa-4f78-ba0b-fe00b974488d\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " Jul 09 16:05:00.815204 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815000 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-home\") pod \"db221ce5-80aa-4f78-ba0b-fe00b974488d\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " Jul 09 16:05:00.815204 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815026 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db221ce5-80aa-4f78-ba0b-fe00b974488d-tls-certs\") pod \"db221ce5-80aa-4f78-ba0b-fe00b974488d\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " Jul 09 16:05:00.815204 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815078 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-model-cache\") pod \"db221ce5-80aa-4f78-ba0b-fe00b974488d\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " Jul 09 16:05:00.815204 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815129 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-tmp-dir\") pod \"db221ce5-80aa-4f78-ba0b-fe00b974488d\" (UID: \"db221ce5-80aa-4f78-ba0b-fe00b974488d\") " Jul 09 16:05:00.815405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815301 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-home" (OuterVolumeSpecName: "home") pod "db221ce5-80aa-4f78-ba0b-fe00b974488d" (UID: "db221ce5-80aa-4f78-ba0b-fe00b974488d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:00.815405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815381 2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-home\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:00.815492 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815407 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-model-cache" (OuterVolumeSpecName: "model-cache") pod "db221ce5-80aa-4f78-ba0b-fe00b974488d" (UID: "db221ce5-80aa-4f78-ba0b-fe00b974488d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:00.815492 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.815473 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "db221ce5-80aa-4f78-ba0b-fe00b974488d" (UID: "db221ce5-80aa-4f78-ba0b-fe00b974488d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:00.817313 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.817287 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-dshm" (OuterVolumeSpecName: "dshm") pod "db221ce5-80aa-4f78-ba0b-fe00b974488d" (UID: "db221ce5-80aa-4f78-ba0b-fe00b974488d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:00.817404 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.817372 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db221ce5-80aa-4f78-ba0b-fe00b974488d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "db221ce5-80aa-4f78-ba0b-fe00b974488d" (UID: "db221ce5-80aa-4f78-ba0b-fe00b974488d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 16:05:00.817404 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.817391 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db221ce5-80aa-4f78-ba0b-fe00b974488d-kube-api-access-96cns" (OuterVolumeSpecName: "kube-api-access-96cns") pod "db221ce5-80aa-4f78-ba0b-fe00b974488d" (UID: "db221ce5-80aa-4f78-ba0b-fe00b974488d"). InnerVolumeSpecName "kube-api-access-96cns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:05:00.916067 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.916027 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96cns\" (UniqueName: \"kubernetes.io/projected/db221ce5-80aa-4f78-ba0b-fe00b974488d-kube-api-access-96cns\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:00.916067 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.916061 2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db221ce5-80aa-4f78-ba0b-fe00b974488d-tls-certs\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:00.916067 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.916071 2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-model-cache\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:00.916067 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.916078 2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-tmp-dir\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:00.916333 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:00.916086 2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db221ce5-80aa-4f78-ba0b-fe00b974488d-dshm\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:01.179865 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.179832 2578 generic.go:356] "Generic (PLEG): container finished" podID="db221ce5-80aa-4f78-ba0b-fe00b974488d" containerID="c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853" exitCode=0 Jul 09 16:05:01.180078 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.179889 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" Jul 09 16:05:01.180078 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.179918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" event={"ID":"db221ce5-80aa-4f78-ba0b-fe00b974488d","Type":"ContainerDied","Data":"c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853"} Jul 09 16:05:01.180078 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.179973 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2" event={"ID":"db221ce5-80aa-4f78-ba0b-fe00b974488d","Type":"ContainerDied","Data":"211db807e429cec2d054fb84e5cb08f22e2f150097f580bc623a0b6351adda1e"} Jul 09 16:05:01.180078 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.179996 2578 scope.go:117] "RemoveContainer" containerID="c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853" Jul 09 16:05:01.189039 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.189021 2578 scope.go:117] "RemoveContainer" containerID="c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853" Jul 09 16:05:01.189367 ip-10-0-128-112 kubenswrapper[2578]: E0709 16:05:01.189348 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853\": container with ID starting with c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853 not found: ID does not exist" containerID="c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853" Jul 09 16:05:01.189435 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.189381 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853"} err="failed to get container status \"c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853\": rpc error: code = NotFound desc = could not find container \"c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853\": container with ID starting with c1af649067703ef143e7e1b7f8eba92140ef2ea37807065647fa72c338672853 not found: ID does not exist" Jul 09 16:05:01.201222 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.201186 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2"] Jul 09 16:05:01.205516 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:01.205488 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2ca941/test-model-2ca941-kserve-76dd86899c-9nqp2"] Jul 09 16:05:02.390107 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:02.390073 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db221ce5-80aa-4f78-ba0b-fe00b974488d" path="/var/lib/kubelet/pods/db221ce5-80aa-4f78-ba0b-fe00b974488d/volumes" Jul 09 16:05:29.030985 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:29.030950 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:29.328245 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:29.328213 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:29.745502 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:29.745414 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:30.183286 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:30.183255 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:30.294514 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:30.294478 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:30.401624 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:30.401592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:30.580681 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:30.580648 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:36.694345 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:36.694258 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:36.793630 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:36.793594 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:36.970921 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:36.970824 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f"] Jul 09 16:05:36.971087 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:36.971043 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" containerID="cri-o://cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db" gracePeriod=30 Jul 09 16:05:36.976107 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:36.976082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:37.075946 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:37.075903 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:37.177616 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:37.177575 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:39.832185 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:39.832148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:39.928460 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:39.928425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:41.426090 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:41.426055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:41.515457 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:41.515421 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:41.657571 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:41.657539 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:41.755767 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:41.755642 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:42.180253 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.180211 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:42.224184 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.224158 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:05:42.253463 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.253427 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:42.279974 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.279939 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-data\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.279974 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.279980 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-socket\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280001 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istiod-ca-cert\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-kube-api-access-tsmwb\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280065 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-certs\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280088 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-credential-socket\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280119 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-podinfo\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280158 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-token\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280537 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280264 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-envoy\") pod \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\" (UID: \"8ce80ab9-b2e4-4436-95fd-3d81d8998de2\") " Jul 09 16:05:42.280537 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280319 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:42.280537 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280485 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:42.280537 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280503 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:05:42.280537 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280509 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-socket\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.280537 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280505 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:42.280895 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.280872 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:42.282542 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.282512 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-kube-api-access-tsmwb" (OuterVolumeSpecName: "kube-api-access-tsmwb") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "kube-api-access-tsmwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:05:42.282655 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.282540 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 16:05:42.282655 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.282557 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:05:42.282655 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.282612 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ce80ab9-b2e4-4436-95fd-3d81d8998de2" (UID: "8ce80ab9-b2e4-4436-95fd-3d81d8998de2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:05:42.380948 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.380847 2578 generic.go:356] "Generic (PLEG): container finished" podID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerID="cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db" exitCode=0 Jul 09 16:05:42.380948 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.380914 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-envoy\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.380948 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.380933 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-data\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.380948 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.380934 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" Jul 09 16:05:42.380948 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.380935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" event={"ID":"8ce80ab9-b2e4-4436-95fd-3d81d8998de2","Type":"ContainerDied","Data":"cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db"} Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.380944 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istiod-ca-cert\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.381030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f" event={"ID":"8ce80ab9-b2e4-4436-95fd-3d81d8998de2","Type":"ContainerDied","Data":"1b103d34dadb6428e453840240353b6a26b965d3a848add1c440bfeedd12e483"} Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.381038 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsmwb\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-kube-api-access-tsmwb\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.381055 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-workload-certs\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.381066 2578 scope.go:117] "RemoveContainer" containerID="cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db" Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.381102 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-credential-socket\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.381216 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-podinfo\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.381405 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.381240 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce80ab9-b2e4-4436-95fd-3d81d8998de2-istio-token\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:05:42.395122 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.395104 2578 scope.go:117] "RemoveContainer" containerID="d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9" Jul 09 16:05:42.403194 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.403171 2578 scope.go:117] "RemoveContainer" containerID="cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db" Jul 09 16:05:42.403493 ip-10-0-128-112 kubenswrapper[2578]: E0709 16:05:42.403471 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db\": container with ID starting with cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db not found: ID does not exist" containerID="cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db" Jul 09 16:05:42.403564 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.403507 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db"} err="failed to get container status \"cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db\": rpc error: code = NotFound desc = could not find container \"cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db\": container with ID starting with cff41345b0c87c4ad9a938b5470c86360ea772abef61318a57764797360226db not found: ID does not exist" Jul 09 16:05:42.403564 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.403533 2578 scope.go:117] "RemoveContainer" containerID="d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9" Jul 09 16:05:42.403816 ip-10-0-128-112 kubenswrapper[2578]: E0709 16:05:42.403797 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9\": container with ID starting with d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9 not found: ID does not exist" containerID="d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9" Jul 09 16:05:42.403868 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.403824 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9"} err="failed to get container status \"d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9\": rpc error: code = NotFound desc = could not find container \"d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9\": container with ID starting with d8bdfcb720654e1154c1b20d0548d7d3e80950941d680a8105ded74159185ba9 not found: ID does not exist" Jul 09 16:05:42.407901 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.407875 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f"] Jul 09 16:05:42.414510 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:42.414483 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2ca941-openshift-default-768f68bc99-wl98f"] Jul 09 16:05:44.389589 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:44.389548 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" path="/var/lib/kubelet/pods/8ce80ab9-b2e4-4436-95fd-3d81d8998de2/volumes" Jul 09 16:05:45.953764 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:45.953731 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:46.470667 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.470629 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:46.778777 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.778682 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5"] Jul 09 16:05:46.779021 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779009 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" Jul 09 16:05:46.779063 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779022 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" Jul 09 16:05:46.779063 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779032 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" Jul 09 16:05:46.779063 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779038 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" Jul 09 16:05:46.779063 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779049 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db221ce5-80aa-4f78-ba0b-fe00b974488d" containerName="main" Jul 09 16:05:46.779063 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779055 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="db221ce5-80aa-4f78-ba0b-fe00b974488d" containerName="main" Jul 09 16:05:46.779213 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779101 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" Jul 09 16:05:46.779213 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779108 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="db221ce5-80aa-4f78-ba0b-fe00b974488d" containerName="main" Jul 09 16:05:46.779213 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.779115 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce80ab9-b2e4-4436-95fd-3d81d8998de2" containerName="istio-proxy" Jul 09 16:05:46.781929 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.781906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.786794 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.786775 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-fae65f-openshift-default-dockercfg-2fz6j\"" Jul 09 16:05:46.798389 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.798363 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5"] Jul 09 16:05:46.812242 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.812217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:46.821497 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istiod-ca-cert\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821646 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-certs\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821646 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-token\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821646 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-credential-socket\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821905 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-envoy\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821905 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-podinfo\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821905 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821748 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gslc\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-kube-api-access-8gslc\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821905 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-socket\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.821905 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.821839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-data\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.922651 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.922601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-podinfo\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.922651 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.922649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gslc\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-kube-api-access-8gslc\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.922956 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.922736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-socket\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.922956 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.922779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-data\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.922956 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.922823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istiod-ca-cert\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.922956 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.922864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-certs\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.922956 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.922892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-token\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.923250 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.923024 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-credential-socket\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.923250 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.923097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-envoy\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.923350 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.923280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-data\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.923350 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.923329 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-certs\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.923456 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.923388 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-socket\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.923527 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.923506 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istiod-ca-cert\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.923582 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.923528 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-credential-socket\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.925108 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.925088 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-envoy\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.925239 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.925222 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-podinfo\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.932304 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.932280 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-token\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:46.932867 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:46.932844 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gslc\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-kube-api-access-8gslc\") pod \"e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:47.052491 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.052458 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:47.092002 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.091963 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:47.240306 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.240280 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5"] Jul 09 16:05:47.242071 ip-10-0-128-112 kubenswrapper[2578]: W0709 16:05:47.242042 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6dca98_29c3_4049_8b46_4e9b8d7d0c6d.slice/crio-c23c9846955f38fac950632168f3377ec8b52ba5afbeacb54963b9663ad8da26 WatchSource:0}: Error finding container c23c9846955f38fac950632168f3377ec8b52ba5afbeacb54963b9663ad8da26: Status 404 returned error can't find the container with id c23c9846955f38fac950632168f3377ec8b52ba5afbeacb54963b9663ad8da26 Jul 09 16:05:47.244437 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.244403 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:05:47.244514 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.244476 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:05:47.244514 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.244505 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:05:47.404889 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.404789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" event={"ID":"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d","Type":"ContainerStarted","Data":"1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788"} Jul 09 16:05:47.404889 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.404847 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" event={"ID":"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d","Type":"ContainerStarted","Data":"c23c9846955f38fac950632168f3377ec8b52ba5afbeacb54963b9663ad8da26"} Jul 09 16:05:47.428013 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:47.427955 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" podStartSLOduration=1.42793993 podStartE2EDuration="1.42793993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 16:05:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:05:47.427070193 +0000 UTC m=+2075.714662891" watchObservedRunningTime="2026-07-09 16:05:47.42793993 +0000 UTC m=+2075.715532652" Jul 09 16:05:48.092768 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:48.092733 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:48.097947 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:48.097917 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:48.409204 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:48.409118 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:48.410080 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:48.410061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:05:49.544500 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:49.544470 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:49.638432 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:49.638398 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:49.826144 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:49.826108 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:50.145505 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:50.145420 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:50.246409 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:50.246374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:05:53.938207 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:05:53.938156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:01.470330 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:01.470291 2578 generic.go:356] "Generic (PLEG): container finished" podID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerID="1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788" exitCode=0 Jul 09 16:06:01.470811 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:01.470363 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" event={"ID":"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d","Type":"ContainerDied","Data":"1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788"} Jul 09 16:06:01.470811 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:01.470730 2578 scope.go:117] "RemoveContainer" containerID="1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788" Jul 09 16:06:01.471743 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:01.471717 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:06:01.471861 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:01.471787 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:06:01.471861 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:01.471818 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 09 16:06:02.224703 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:02.224651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:02.478222 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:02.478123 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" event={"ID":"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d","Type":"ContainerStarted","Data":"3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c"} Jul 09 16:06:02.692391 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:02.692345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:03.092586 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:03.092551 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:06:03.093521 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:03.093499 2578 patch_prober.go:28] interesting pod/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 16:06:03.093581 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:03.093549 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 16:06:03.412882 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:03.412785 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:06:04.092828 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:04.092782 2578 patch_prober.go:28] interesting pod/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 16:06:04.093354 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:04.092851 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 16:06:04.888629 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:04.888595 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:04.946641 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:04.946607 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:05.093908 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:05.093872 2578 patch_prober.go:28] interesting pod/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 16:06:05.094515 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:05.094480 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 16:06:06.093215 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:06.093169 2578 patch_prober.go:28] interesting pod/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 16:06:06.093540 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:06.093509 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 16:06:07.093360 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:07.093311 2578 patch_prober.go:28] interesting pod/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" start-of-body= Jul 09 16:06:07.093896 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:07.093393 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.35:15021/healthz/ready\": dial tcp 10.132.0.35:15021: connect: connection refused" Jul 09 16:06:08.097498 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:08.097467 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:06:08.098544 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:08.098527 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:06:08.933653 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:08.933623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:09.033810 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:09.033774 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:09.228263 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:09.228180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:09.638346 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:09.638312 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:10.066956 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:10.066924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:10.167098 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:10.167064 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:10.266044 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:10.266004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:10.395441 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:10.395326 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:12.304381 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:12.304355 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 16:06:12.305062 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:12.305039 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 16:06:12.308023 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:12.308002 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 16:06:12.308570 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:12.308552 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w7hnj_42cc97fb-6cca-46a9-ace1-8060bbf1ade3/ovn-acl-logging/0.log" Jul 09 16:06:16.560987 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:16.560918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:16.661073 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:16.661033 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:16.811199 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:16.811107 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5"] Jul 09 16:06:16.811395 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:16.811346 2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" containerID="cri-o://3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c" gracePeriod=30 Jul 09 16:06:16.831856 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:16.831822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:17.466868 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:17.466818 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:17.798677 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:17.798635 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:17.986904 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:17.986868 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:20.612959 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:20.612928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:20.693120 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:20.693077 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:20.755894 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:20.755863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:22.060889 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.060863 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:06:22.146809 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146703 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-credential-socket\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.146809 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146776 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-socket\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.146809 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146809 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gslc\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-kube-api-access-8gslc\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.147102 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146836 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istiod-ca-cert\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.147102 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146875 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-certs\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.147102 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146927 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:06:22.147102 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146939 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-token\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.147102 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.146997 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-podinfo\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.147102 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147054 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-envoy\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.147102 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147091 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:06:22.147526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147109 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-data\") pod \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\" (UID: \"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d\") " Jul 09 16:06:22.147526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147289 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:06:22.147526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147305 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 16:06:22.147526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147362 2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-certs\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.147526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147380 2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-credential-socket\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.147526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147396 2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-workload-socket\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.147526 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.147411 2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istiod-ca-cert\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.148039 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.148013 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:06:22.149152 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.149127 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-kube-api-access-8gslc" (OuterVolumeSpecName: "kube-api-access-8gslc") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "kube-api-access-8gslc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:06:22.149345 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.149324 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 16:06:22.149511 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.149482 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 16:06:22.149609 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.149581 2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" (UID: "cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 16:06:22.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.248214 2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-token\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.248248 2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-podinfo\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.248261 2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-envoy\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.248259 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.248272 2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-istio-data\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.248538 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.248283 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gslc\" (UniqueName: \"kubernetes.io/projected/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d-kube-api-access-8gslc\") on node \"ip-10-0-128-112.ec2.internal\" DevicePath \"\"" Jul 09 16:06:22.576983 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.576951 2578 generic.go:356] "Generic (PLEG): container finished" podID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerID="3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c" exitCode=0 Jul 09 16:06:22.577181 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.577000 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" Jul 09 16:06:22.577181 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.576999 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" event={"ID":"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d","Type":"ContainerDied","Data":"3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c"} Jul 09 16:06:22.577181 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.577137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5" event={"ID":"cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d","Type":"ContainerDied","Data":"c23c9846955f38fac950632168f3377ec8b52ba5afbeacb54963b9663ad8da26"} Jul 09 16:06:22.577181 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.577167 2578 scope.go:117] "RemoveContainer" containerID="3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c" Jul 09 16:06:22.585977 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.585949 2578 scope.go:117] "RemoveContainer" containerID="1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788" Jul 09 16:06:22.593922 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.593881 2578 scope.go:117] "RemoveContainer" containerID="3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c" Jul 09 16:06:22.594264 ip-10-0-128-112 kubenswrapper[2578]: E0709 16:06:22.594212 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c\": container with ID starting with 3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c not found: ID does not exist" containerID="3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c" Jul 09 16:06:22.594354 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.594255 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c"} err="failed to get container status \"3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c\": rpc error: code = NotFound desc = could not find container \"3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c\": container with ID starting with 3c34667bf00cc19489f2fc3a387699cbe9929da6816addefc9cb6381e701730c not found: ID does not exist" Jul 09 16:06:22.594354 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.594283 2578 scope.go:117] "RemoveContainer" containerID="1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788" Jul 09 16:06:22.594554 ip-10-0-128-112 kubenswrapper[2578]: E0709 16:06:22.594537 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788\": container with ID starting with 1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788 not found: ID does not exist" containerID="1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788" Jul 09 16:06:22.594590 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.594559 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788"} err="failed to get container status \"1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788\": rpc error: code = NotFound desc = could not find container \"1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788\": container with ID starting with 1559f3f1bbf0d9adde0d16f4644f6c3437727b7926a341057bf6a37d03995788 not found: ID does not exist" Jul 09 16:06:22.595843 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.595821 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5"] Jul 09 16:06:22.602130 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.602107 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-fae65f-openshift-default-5ccfccbd47-dv6j5"] Jul 09 16:06:22.960865 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:22.960828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:23.061370 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:23.061336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:24.390316 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:24.390273 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" path="/var/lib/kubelet/pods/cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d/volumes" Jul 09 16:06:25.126614 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:25.126583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:25.493857 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:25.493763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:25.825630 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:25.825601 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:26.631306 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:26.631269 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:27.558267 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:27.558231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:28.723469 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:28.723437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:28.823345 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:28.823304 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:30.592896 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:30.592854 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:30.692416 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:30.692374 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:33.246580 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:33.246543 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:41.987121 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:41.987079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:42.088662 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:42.088628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:50.113948 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:50.113907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:50.214968 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:50.214936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:50.339670 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:50.339634 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:06:50.440478 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:06:50.440394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:08:15.741521 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:08:15.741486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:08:15.841151 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:08:15.841115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:00.740399 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:00.740366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:20.648382 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:20.648325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:38.457113 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:38.457069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:38.898913 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:38.898862 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:38.997075 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:38.997022 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:39.097194 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:39.097159 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:39.225172 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:39.225067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:45.079369 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:45.079325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:45.140507 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:45.140463 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:45.385264 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:45.385161 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:45.772662 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:45.772568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:46.221121 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:46.221047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:46.320745 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:46.320710 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:46.494821 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:46.494720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:52.476013 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:52.475957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:52.542141 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:52.542092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:52.747234 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:52.747154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:09:53.532822 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:53.532792 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d5489b7d5-q5hws_46537406-b272-4569-b7b1-ea88b825f01a/authorino/0.log" Jul 09 16:09:58.856713 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:58.856657 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fdc99_d721bf01-9b74-431e-97dd-b0382e33aeac/server/0.log" Jul 09 16:09:59.113454 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:59.113347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bb557cf6-628pp_cea3a6b9-475e-4fa7-9f90-ee2f903a722f/copy-manifests/0.log" Jul 09 16:09:59.127543 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:09:59.127511 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bb557cf6-628pp_cea3a6b9-475e-4fa7-9f90-ee2f903a722f/manager/0.log" Jul 09 16:10:00.814654 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:00.814623 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d5489b7d5-q5hws_46537406-b272-4569-b7b1-ea88b825f01a/authorino/0.log" Jul 09 16:10:02.068227 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:02.068189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vrk6q_40ab11d7-916c-40b2-a96b-b5c08b144d14/istio-proxy/0.log" Jul 09 16:10:02.319217 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:02.319139 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f9565468-6r8gb_8a585f98-7117-4e74-a5c8-175b08c19ff8/kube-auth-proxy/0.log" Jul 09 16:10:03.680293 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:03.680190 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbs6g45_b5444a4a-e370-4ae3-99cc-7a340783cc50/main/0.log" Jul 09 16:10:03.803412 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:03.803388 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-tnmxd_a4492cbb-fc76-4b40-af53-5d27ca162e5c/main/0.log" Jul 09 16:10:08.352037 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:08.351991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:10:08.451865 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:08.451829 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:10:12.847843 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:12.847809 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vrps5_00d86721-e2ea-4598-a3a0-a84b11b71f54/global-pull-secret-syncer/0.log" Jul 09 16:10:12.900402 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:12.895562 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" Jul 09 16:10:12.976546 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:12.976513 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-112.ec2.internal_0b440d2d8752bd70c3497ee880d25f6a/haproxy/0.log" Jul 09 16:10:17.572573 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:17.572541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d5489b7d5-q5hws_46537406-b272-4569-b7b1-ea88b825f01a/authorino/0.log" Jul 09 16:10:20.327568 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:20.327538 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcngb_192155bb-0765-4f28-9887-3a654e8cc426/node-exporter/0.log" Jul 09 16:10:20.357577 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:20.357554 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcngb_192155bb-0765-4f28-9887-3a654e8cc426/kube-rbac-proxy/0.log" Jul 09 16:10:20.381582 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:20.381550 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zcngb_192155bb-0765-4f28-9887-3a654e8cc426/init-textfile/0.log" Jul 09 16:10:20.811895 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:20.811841 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c84dfd4fb-vzt9q_371441d4-56b7-423c-8d5a-91402842b5bb/telemeter-client/0.log" Jul 09 16:10:20.836752 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:20.836723 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c84dfd4fb-vzt9q_371441d4-56b7-423c-8d5a-91402842b5bb/reload/0.log" Jul 09 16:10:20.859681 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:20.859652 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-c84dfd4fb-vzt9q_371441d4-56b7-423c-8d5a-91402842b5bb/kube-rbac-proxy/0.log" Jul 09 16:10:22.229615 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.229575 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm"] Jul 09 16:10:22.230076 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.229894 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" Jul 09 16:10:22.230076 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.229904 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" Jul 09 16:10:22.230076 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.229916 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" Jul 09 16:10:22.230076 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.229923 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" Jul 09 16:10:22.230076 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.229984 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6dca98-29c3-4049-8b46-4e9b8d7d0c6d" containerName="istio-proxy" Jul 09 16:10:22.232929 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.232910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.234893 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.234867 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-t7pqb_494655c0-bdb4-45fc-a4bd-74c75339bd0c/networking-console-plugin/0.log" Jul 09 16:10:22.235458 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.235438 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qrm8\"/\"kube-root-ca.crt\"" Jul 09 16:10:22.235540 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.235481 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9qrm8\"/\"openshift-service-ca.crt\"" Jul 09 16:10:22.235540 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.235519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9qrm8\"/\"default-dockercfg-xvqd8\"" Jul 09 16:10:22.242601 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.242574 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm"] Jul 09 16:10:22.405600 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.405565 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-sys\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.405600 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.405601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxfkm\" (UniqueName: \"kubernetes.io/projected/57553cd7-e978-40b9-95b6-e3d91d185410-kube-api-access-dxfkm\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.405866 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.405642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-proc\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.405866 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.405704 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-podres\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.405866 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.405731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-lib-modules\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506568 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506463 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-proc\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506568 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-podres\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506568 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-lib-modules\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506833 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506596 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-proc\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506833 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506608 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-sys\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506833 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506655 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxfkm\" (UniqueName: \"kubernetes.io/projected/57553cd7-e978-40b9-95b6-e3d91d185410-kube-api-access-dxfkm\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506833 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506746 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-lib-modules\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506833 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506746 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-podres\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.506833 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.506786 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57553cd7-e978-40b9-95b6-e3d91d185410-sys\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.517460 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.517431 2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxfkm\" (UniqueName: \"kubernetes.io/projected/57553cd7-e978-40b9-95b6-e3d91d185410-kube-api-access-dxfkm\") pod \"perf-node-gather-daemonset-kstdm\" (UID: \"57553cd7-e978-40b9-95b6-e3d91d185410\") " pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.543684 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.543640 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:22.677649 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.677624 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm"] Jul 09 16:10:22.680497 ip-10-0-128-112 kubenswrapper[2578]: W0709 16:10:22.680467 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod57553cd7_e978_40b9_95b6_e3d91d185410.slice/crio-62e76361e515fbefc5a42ea7b19b45f299b810c48cc5702451515ede3b7431d7 WatchSource:0}: Error finding container 62e76361e515fbefc5a42ea7b19b45f299b810c48cc5702451515ede3b7431d7: Status 404 returned error can't find the container with id 62e76361e515fbefc5a42ea7b19b45f299b810c48cc5702451515ede3b7431d7 Jul 09 16:10:22.911131 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.911096 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/1.log" Jul 09 16:10:22.915839 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:22.915817 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-kcbkq_de3d5cb5-ef82-48b2-9120-29b3b0908a97/console-operator/2.log" Jul 09 16:10:23.627886 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:23.627845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" event={"ID":"57553cd7-e978-40b9-95b6-e3d91d185410","Type":"ContainerStarted","Data":"e34a3a27fb1b5d7e2dc94a25d8a3bd221bcd720736204d381c9ab309d0053e5c"} Jul 09 16:10:23.628352 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:23.627908 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" event={"ID":"57553cd7-e978-40b9-95b6-e3d91d185410","Type":"ContainerStarted","Data":"62e76361e515fbefc5a42ea7b19b45f299b810c48cc5702451515ede3b7431d7"} Jul 09 16:10:23.628352 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:23.627977 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:23.646208 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:23.646151 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" podStartSLOduration=1.6461351 podStartE2EDuration="1.6461351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 16:10:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 16:10:23.645383239 +0000 UTC m=+2351.932975948" watchObservedRunningTime="2026-07-09 16:10:23.6461351 +0000 UTC m=+2351.933727798" Jul 09 16:10:25.067577 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:25.067546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9fsrz_59f60fe0-0d41-4bb1-abb9-7436adeab01e/dns/0.log" Jul 09 16:10:25.093451 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:25.093420 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9fsrz_59f60fe0-0d41-4bb1-abb9-7436adeab01e/kube-rbac-proxy/0.log" Jul 09 16:10:25.295482 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:25.295449 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rphtv_83e27e52-cff5-4bc7-bb69-ad9404382a80/dns-node-resolver/0.log" Jul 09 16:10:25.914618 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:25.914588 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g6kp4_158590de-96c7-40e6-bde3-a5e115670c8d/node-ca/0.log" Jul 09 16:10:26.927609 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:26.927580 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vrk6q_40ab11d7-916c-40b2-a96b-b5c08b144d14/istio-proxy/0.log" Jul 09 16:10:27.053236 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:27.053210 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f9565468-6r8gb_8a585f98-7117-4e74-a5c8-175b08c19ff8/kube-auth-proxy/0.log" Jul 09 16:10:27.997520 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:27.997494 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r68gb_01f3ba4e-b51b-469b-a118-cbbfc543f9c9/serve-healthcheck-canary/0.log" Jul 09 16:10:28.571307 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:28.571282 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mkhww_b58a6bf7-f7f0-43e0-b9ed-66774c77a97f/kube-rbac-proxy/0.log" Jul 09 16:10:28.594623 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:28.594591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mkhww_b58a6bf7-f7f0-43e0-b9ed-66774c77a97f/exporter/0.log" Jul 09 16:10:28.617745 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:28.617717 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mkhww_b58a6bf7-f7f0-43e0-b9ed-66774c77a97f/extractor/0.log" Jul 09 16:10:29.642976 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:29.642950 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9qrm8/perf-node-gather-daemonset-kstdm" Jul 09 16:10:31.216501 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:31.216460 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fdc99_d721bf01-9b74-431e-97dd-b0382e33aeac/server/0.log" Jul 09 16:10:31.366201 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:31.366160 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bb557cf6-628pp_cea3a6b9-475e-4fa7-9f90-ee2f903a722f/manager/0.log" Jul 09 16:10:31.385142 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:31.385113 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9bb557cf6-628pp_cea3a6b9-475e-4fa7-9f90-ee2f903a722f/copy-manifests/0.log" Jul 09 16:10:32.143846 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:32.143813 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vrk6q_40ab11d7-916c-40b2-a96b-b5c08b144d14/istio-proxy/0.log" Jul 09 16:10:32.256198 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:32.256166 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f9565468-6r8gb_8a585f98-7117-4e74-a5c8-175b08c19ff8/kube-auth-proxy/0.log" Jul 09 16:10:32.864656 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:32.864631 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c8fc68c98-x2cqx_2af14a2e-f381-46d9-b0a6-e4a022316e1c/manager/0.log" Jul 09 16:10:33.582705 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:33.582669 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678vrk6q_40ab11d7-916c-40b2-a96b-b5c08b144d14/istio-proxy/0.log" Jul 09 16:10:33.681967 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:33.681938 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57f9565468-6r8gb_8a585f98-7117-4e74-a5c8-175b08c19ff8/kube-auth-proxy/0.log" Jul 09 16:10:37.748414 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:37.748384 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:10:38.049602 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:38.049565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7c6sc_520ce4bf-58fc-4ac2-a718-eae2c7759ebd/konnectivity-agent/0.log" limit=1024 Jul 09 16:10:38.276035 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:38.275990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-x52ds_778ef260-1256-44b9-a53d-c9a82135ee78/kube-storage-version-migrator-operator/1.log" Jul 09 16:10:38.276893 ip-10-0-128-112 kubenswrapper[2578]: I0709 16:10:38.276872 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-x52ds_778ef260-1256-44b9-a53d-c9a82135ee78/kube-storage-version-migrator-operator/0.log"