Jul 03 20:30:22.589549 ip-10-0-128-211 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 03 20:30:22.589560 ip-10-0-128-211 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 03 20:30:22.589570 ip-10-0-128-211 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 03 20:30:22.590159 ip-10-0-128-211 systemd[1]: Failed to start Kubernetes Kubelet. Jul 03 20:30:32.711261 ip-10-0-128-211 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 03 20:30:32.711284 ip-10-0-128-211 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 379f188401c3464093930c3e5d351753 -- Jul 03 20:32:22.948038 ip-10-0-128-211 systemd[1]: Starting Kubernetes Kubelet... Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.476813 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483277 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483298 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483301 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483304 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483307 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483309 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483312 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 20:32:23.494734 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483315 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483317 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483321 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483323 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483326 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483329 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483332 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483334 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483337 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483339 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483347 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483350 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483352 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483355 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483357 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483360 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483362 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483365 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483367 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483370 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 20:32:23.496036 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483373 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483376 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483378 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483381 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483383 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483386 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483388 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483392 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483394 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483397 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483400 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483403 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483406 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483409 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483411 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483414 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483417 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483420 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483423 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483426 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 20:32:23.497167 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483428 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483431 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483440 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483442 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483446 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483448 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483450 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483453 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483455 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483458 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483461 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483464 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483466 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483469 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483472 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483474 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483477 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483479 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483482 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483484 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 20:32:23.498076 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483487 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483489 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483492 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483494 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483497 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483499 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483502 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483505 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483507 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483510 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483513 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483519 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483522 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483525 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483528 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483536 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483539 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483541 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483544 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 20:32:23.498959 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483546 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483549 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483551 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483554 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483582 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483586 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483589 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483592 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483597 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483601 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483604 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483608 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.483611 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484489 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484497 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484500 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484503 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484506 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484510 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 20:32:23.499865 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484513 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484516 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484519 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484521 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484524 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484527 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484530 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484532 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484535 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484537 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484546 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484549 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484551 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484554 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484556 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484559 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484562 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484565 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484567 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484570 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 20:32:23.503265 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484573 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484575 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484578 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484580 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484583 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484586 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484588 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484591 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484593 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484597 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484600 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484602 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484605 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484607 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484610 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484615 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484618 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484621 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484624 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 20:32:23.504774 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484627 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484630 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484633 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484635 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484646 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484649 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484652 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484654 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484657 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484660 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484662 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484665 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484668 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484670 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484673 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484675 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484677 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484680 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484698 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 20:32:23.506445 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484704 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484707 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484711 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484713 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484716 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484719 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484721 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484724 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484726 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484729 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484731 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484734 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484736 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484739 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484743 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484745 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484748 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484751 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484760 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484763 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 20:32:23.507461 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484766 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484769 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484771 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484775 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484778 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484781 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484784 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484787 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484789 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484792 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484795 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484797 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484800 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484803 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.484805 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485307 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485312 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485315 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485318 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 20:32:23.508715 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485321 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485324 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485327 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485330 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485332 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485335 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485338 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485341 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485344 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485346 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485349 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485357 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485361 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485365 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485369 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485371 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485374 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485377 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485380 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485383 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 20:32:23.509712 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485385 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485390 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485393 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485396 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485399 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485402 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485404 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485407 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485409 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485412 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485414 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485420 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485423 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485427 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485431 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485434 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485436 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485439 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485442 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485445 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 20:32:23.514706 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485447 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485450 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485453 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485455 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485464 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485472 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485475 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485478 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485480 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485483 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485485 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485487 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485490 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485493 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485496 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485500 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485504 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485507 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485510 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 20:32:23.515722 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485512 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485515 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485517 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485520 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485526 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485528 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485530 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485533 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485535 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485538 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485540 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485543 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485545 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485548 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485550 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485552 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485555 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485557 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485565 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485568 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 20:32:23.517443 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485571 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485573 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485576 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485578 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485580 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485583 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485585 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485588 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485590 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485594 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485597 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485599 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485602 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485605 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485607 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.485609 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485705 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485713 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485722 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485727 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485731 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 03 20:32:23.518440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485734 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485738 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485743 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485746 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485749 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485753 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485756 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485759 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485762 2578 flags.go:64] FLAG: --cgroup-root="" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485765 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485774 2578 flags.go:64] FLAG: --client-ca-file="" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485777 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485781 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485787 2578 flags.go:64] FLAG: --cluster-domain="" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485790 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485793 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485797 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485800 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485804 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485807 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485812 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485815 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485818 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485821 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 03 20:32:23.519658 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485824 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485828 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485830 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485836 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485840 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485842 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485845 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485848 2578 flags.go:64] FLAG: --enable-server="true" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485851 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485858 2578 flags.go:64] FLAG: --event-burst="100" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485861 2578 flags.go:64] FLAG: --event-qps="50" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485864 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485867 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485870 2578 flags.go:64] FLAG: --eviction-hard="" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485874 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485877 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485880 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485883 2578 flags.go:64] FLAG: --eviction-soft="" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485886 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485895 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485898 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485901 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485904 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485907 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485910 2578 flags.go:64] FLAG: --feature-gates="" Jul 03 20:32:23.591989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485914 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485917 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485921 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485925 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485928 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485931 2578 flags.go:64] FLAG: --help="false" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485934 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-211.ec2.internal" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485938 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485941 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485944 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485949 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485952 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485955 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485958 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485961 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485964 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485967 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485970 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485973 2578 flags.go:64] FLAG: --kube-reserved="" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485976 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485979 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485982 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485985 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485987 2578 flags.go:64] FLAG: --lock-file="" Jul 03 20:32:23.592826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485990 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485993 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.485996 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486008 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486011 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486014 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486017 2578 flags.go:64] FLAG: --logging-format="text" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486020 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486023 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486026 2578 flags.go:64] FLAG: --manifest-url="" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486029 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486034 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486037 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486041 2578 flags.go:64] FLAG: --max-pods="110" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486044 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486047 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486050 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486053 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486057 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486060 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486063 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486071 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486074 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486077 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 03 20:32:23.593565 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486080 2578 flags.go:64] FLAG: --pod-cidr="" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486083 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486089 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486092 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486095 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486098 2578 flags.go:64] FLAG: --port="10250" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486101 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486104 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a33c7ae45e9ed3a3" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486107 2578 flags.go:64] FLAG: --qos-reserved="" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486110 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486113 2578 flags.go:64] FLAG: --register-node="true" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486116 2578 flags.go:64] FLAG: --register-with-taints="" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486125 2578 flags.go:64] FLAG: --registry-burst="10" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486128 2578 flags.go:64] FLAG: --registry-qps="5" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486131 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486135 2578 flags.go:64] FLAG: --reserved-memory="" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486138 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486141 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486144 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486149 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486152 2578 flags.go:64] FLAG: --runonce="false" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486155 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486158 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486161 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486164 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 03 20:32:23.594449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486166 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486169 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486173 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486176 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486180 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486183 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486185 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486188 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486191 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486194 2578 flags.go:64] FLAG: --system-cgroups="" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486197 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486202 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486205 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486208 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486214 2578 flags.go:64] FLAG: --tls-min-version="" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486217 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486220 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486223 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486226 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486229 2578 flags.go:64] FLAG: --v="2" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486238 2578 flags.go:64] FLAG: --version="false" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486242 2578 flags.go:64] FLAG: --vmodule="" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486246 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.486249 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486403 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 20:32:23.595199 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486408 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486412 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486415 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486417 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486420 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486423 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486425 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486428 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486431 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486435 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486438 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486440 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486443 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486445 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486448 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486450 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486453 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486455 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486458 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 20:32:23.596012 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486461 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486463 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486465 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486468 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486470 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486473 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486476 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486478 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486481 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486489 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486491 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486494 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486496 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486499 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486503 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486505 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486508 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486510 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486513 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486515 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 20:32:23.596781 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486518 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486520 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486526 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486529 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486531 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486534 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486536 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486539 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486541 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486544 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486546 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486548 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486551 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486553 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486556 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486558 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486561 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486563 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486567 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486571 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 20:32:23.597438 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486574 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486576 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486584 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486587 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486589 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486591 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486595 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486598 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486600 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486603 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486605 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486608 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486610 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486613 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486616 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486620 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486623 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486626 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486629 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 20:32:23.598157 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486632 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486635 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486638 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486640 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486643 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486645 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486649 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486653 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486656 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486658 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486661 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486663 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486666 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486669 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486671 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486674 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486695 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486698 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486701 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 20:32:23.598810 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.486704 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.487328 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.542712 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.542736 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.542782 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.542788 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542855 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542861 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542865 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542869 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542872 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542875 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542877 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542880 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 20:32:23.599515 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542884 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542887 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542890 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542892 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542895 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542898 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542901 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542904 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542907 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542910 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542913 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542917 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542919 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542922 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542925 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542927 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542930 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542933 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542936 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542940 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 20:32:23.600030 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542943 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542945 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542948 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542951 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542954 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542957 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542960 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542962 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542965 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542968 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542973 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542977 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542982 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542986 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542989 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542992 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542995 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.542998 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543001 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543004 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 20:32:23.600587 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543007 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543011 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543014 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543017 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543020 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543024 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543027 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543031 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543035 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543039 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543042 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543045 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543048 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543051 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543054 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543057 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543060 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543063 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543065 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 20:32:23.601201 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543068 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543071 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543074 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543078 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543081 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543084 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543087 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543090 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543092 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543095 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543099 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543102 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543105 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543108 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543111 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543114 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543117 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543120 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543123 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543125 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 20:32:23.601846 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543128 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543131 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543134 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543137 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543141 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543145 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543148 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543151 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543155 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543158 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543161 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543164 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.543170 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543314 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543320 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 03 20:32:23.602454 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543324 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543327 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543330 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543333 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543336 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543340 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543343 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543347 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543351 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543355 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543358 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543362 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543365 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543368 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543371 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543373 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543376 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543379 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543382 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543385 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 03 20:32:23.605684 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543388 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543390 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543393 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543396 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543399 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543401 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543404 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543407 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543410 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543413 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543416 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543419 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543422 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543426 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543429 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543431 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543435 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543437 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543440 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543443 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 03 20:32:23.606625 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543446 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543449 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543452 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543455 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543458 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543461 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543464 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543466 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543469 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543472 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543474 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543477 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543480 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543484 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543488 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543492 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543495 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543498 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543500 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543503 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 03 20:32:23.607633 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543506 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543509 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543513 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543516 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543518 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543521 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543524 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543526 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543529 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543532 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543534 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543537 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543540 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543543 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543545 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543549 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543552 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543556 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543559 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 03 20:32:23.608628 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543562 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543565 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543568 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543572 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543574 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543577 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543580 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543583 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543586 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543589 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543592 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543595 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543598 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543602 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543605 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543607 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543610 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 03 20:32:23.609606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:23.543613 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.543618 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.543820 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.546242 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.548201 2578 server.go:1019] "Starting client certificate rotation" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.548310 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.548355 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.553700 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.555138 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.572010 2578 log.go:25] "Validated CRI v1 runtime API" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.575337 2578 log.go:25] "Validated CRI v1 image API" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.576822 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 03 20:32:23.610571 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.582235 2578 fs.go:135] Filesystem UUIDs: map[367a58b3-9706-407e-8317-f4ee00f2c4c8:/dev/nvme0n1p4 68b352d6-0f4b-4f1b-af26-d52f6e506d70:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 03 20:32:23.695470 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.582265 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 03 20:32:23.695470 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.591821 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 20:32:23.616372 ip-10-0-128-211 systemd[1]: Started Kubernetes Kubelet. Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.592750 2578 manager.go:216] Machine: {Timestamp:2026-07-03 20:32:23.59095506 +0000 UTC m=+0.499816496 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099490 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28c1029cdc3870216d7a47c4101b0b SystemUUID:ec28c102-9cdc-3870-216d-7a47c4101b0b BootID:379f1884-01c3-4640-9393-0c3e5d351753 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:18:70:65:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:18:70:65:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:08:13:af:93:94 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.592877 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.593041 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.597548 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.597585 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-211.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.598423 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.598434 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.598442 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.598457 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.599948 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.603522 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.603677 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.603711 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.603726 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.603747 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.603778 2578 kubelet.go:398] "Adding apiserver pod source" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.603793 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 03 20:32:23.696483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.604254 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.604277 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.606652 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.608781 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.608813 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610223 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610237 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610243 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610250 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610260 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610267 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610276 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610282 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610291 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610296 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610306 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.610311 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.612285 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.612295 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.613919 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q6m5z" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.615590 2578 server.go:1268] "Started kubelet" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.616025 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.618916 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.619997 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.620060 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.621219 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.622156 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-q6m5z" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.624489 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-211.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.625358 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-211.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.625358 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.627583 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.628038 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.628277 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.628807 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629192 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629211 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629243 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629356 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629367 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629859 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629876 2578 factory.go:55] Registering systemd factory Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.629887 2578 factory.go:223] Registration of the systemd container factory successfully Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.630153 2578 factory.go:153] Registering CRI-O factory Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.630183 2578 factory.go:223] Registration of the crio container factory successfully Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.630207 2578 factory.go:103] Registering Raw factory Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.630231 2578 manager.go:1196] Started watching for new ooms in manager Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.631039 2578 manager.go:349] Starting recovery of all containers Jul 03 20:32:23.697499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.640184 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.642768 2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-211.ec2.internal\" not found" node="ip-10-0-128-211.ec2.internal" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.656796 2578 manager.go:354] Recovery completed Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.661395 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.663552 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientMemory" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.663580 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.663591 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientPID" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.664223 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.664231 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.664250 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.664977 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.665609 2578 policy_none.go:49] "None policy: Start" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.665626 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.665637 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.665796 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientMemory" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.665822 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.665832 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientPID" Jul 03 20:32:23.699115 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.666752 2578 policy_none.go:47] "Start" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.729307 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.830126 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.832615 2578 manager.go:337] "Starting Device Plugin manager" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.832654 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.832668 2578 server.go:87] "Starting device plugin registration server" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.833017 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.833031 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.833182 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.833458 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.833471 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.833902 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 03 20:32:23.836125 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:23.833948 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:23.852363 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:23.851113 2578 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2614 into the system container \"/system.slice\": " Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.196067 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.197513 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientMemory" Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.197545 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.197561 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientPID" Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.197590 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.206873 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.206899 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-211.ec2.internal\": node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.255008 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.222044 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.392671 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.322201 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.524916 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.422879 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.524916 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.523639 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.642832 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.547285 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 03 20:32:24.642832 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.547448 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 03 20:32:24.642832 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.624288 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.642832 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.626905 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 20:27:24 +0000 UTC" deadline="2028-04-19 04:58:55.411386006 +0000 UTC" Jul 03 20:32:24.642832 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.626941 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15728h26m30.78444796s" Jul 03 20:32:24.725284 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.725240 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.736968 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.736942 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 20:32:24.746887 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.746848 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 03 20:32:24.748131 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.748112 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 03 20:32:24.748185 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.748165 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 03 20:32:24.748233 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.748195 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 03 20:32:24.748287 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.748241 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 03 20:32:24.751010 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.750989 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 20:32:24.826252 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.826159 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.850127 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.850081 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal"] Jul 03 20:32:24.850231 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.850187 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 20:32:24.851265 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.851249 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientMemory" Jul 03 20:32:24.851346 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.851280 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 20:32:24.851346 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.851290 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientPID" Jul 03 20:32:24.852603 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.852590 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 20:32:24.852750 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.852716 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.852750 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.852748 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 20:32:24.853483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.853464 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientMemory" Jul 03 20:32:24.853560 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.853501 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 20:32:24.853560 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.853511 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientMemory" Jul 03 20:32:24.853560 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.853538 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 20:32:24.853560 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.853551 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientPID" Jul 03 20:32:24.853560 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.853515 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientPID" Jul 03 20:32:24.854912 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.854894 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.855005 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.854921 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 03 20:32:24.855698 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.855660 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientMemory" Jul 03 20:32:24.855698 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.855693 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasNoDiskPressure" Jul 03 20:32:24.855822 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.855706 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeHasSufficientPID" Jul 03 20:32:24.871511 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.871484 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-211.ec2.internal\" not found" node="ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.876330 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.876312 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-211.ec2.internal\" not found" node="ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.926606 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:24.926575 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:24.934542 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.934517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171f32fba5ebc11b21af46d56737b784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal\" (UID: \"171f32fba5ebc11b21af46d56737b784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.934612 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.934546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171f32fba5ebc11b21af46d56737b784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal\" (UID: \"171f32fba5ebc11b21af46d56737b784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:24.934612 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:24.934568 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e7ee0ea579cbfd49e6032150d18c00c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-211.ec2.internal\" (UID: \"4e7ee0ea579cbfd49e6032150d18c00c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.028160 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.028113 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-211.ec2.internal\" not found" Jul 03 20:32:25.034740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.034715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171f32fba5ebc11b21af46d56737b784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal\" (UID: \"171f32fba5ebc11b21af46d56737b784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.034831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.034766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171f32fba5ebc11b21af46d56737b784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal\" (UID: \"171f32fba5ebc11b21af46d56737b784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.034831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.034785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e7ee0ea579cbfd49e6032150d18c00c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-211.ec2.internal\" (UID: \"4e7ee0ea579cbfd49e6032150d18c00c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.034831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.034790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/171f32fba5ebc11b21af46d56737b784-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal\" (UID: \"171f32fba5ebc11b21af46d56737b784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.034940 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.034818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/171f32fba5ebc11b21af46d56737b784-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal\" (UID: \"171f32fba5ebc11b21af46d56737b784\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.034940 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.034882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e7ee0ea579cbfd49e6032150d18c00c-config\") pod \"kube-apiserver-proxy-ip-10-0-128-211.ec2.internal\" (UID: \"4e7ee0ea579cbfd49e6032150d18c00c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.076921 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.076854 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 20:32:25.129235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.129206 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.146792 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.146755 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 20:32:25.147831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.147817 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.155882 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.155863 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 03 20:32:25.174795 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.174747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.180119 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.180097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" Jul 03 20:32:25.608011 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.607982 2578 apiserver.go:52] "Watching apiserver" Jul 03 20:32:25.620931 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.620900 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 03 20:32:25.622404 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.622373 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-p69p8","openshift-image-registry/node-ca-qzjfr","openshift-multus/network-metrics-daemon-frps2","openshift-network-diagnostics/network-check-target-mrnzz","openshift-network-operator/iptables-alerter-csn2w","kube-system/konnectivity-agent-6kblm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal","openshift-multus/multus-additional-cni-plugins-dpshh","openshift-multus/multus-s7zdt","openshift-ovn-kubernetes/ovnkube-node-wsv94","kube-system/global-pull-secret-syncer-2lk2t","kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal","openshift-cluster-node-tuning-operator/tuned-d4tpq"] Jul 03 20:32:25.624564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.624538 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.626286 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.626259 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.627638 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.627615 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 03 20:32:25.627638 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.627629 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:25.627850 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.627755 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:25.627850 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.627633 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-njhrx\"" Jul 03 20:32:25.627850 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.627639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 03 20:32:25.628108 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.628094 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 03 20:32:25.628720 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.628703 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 03 20:32:25.629068 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.629052 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 03 20:32:25.629068 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.629064 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:25.629210 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.629069 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 03 20:32:25.629210 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.629118 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:25.630219 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.630201 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 03 20:32:25.630371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.630355 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.630899 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.630868 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 03 20:32:25.631028 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.631007 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 03 20:32:25.631104 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.631031 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 03 20:32:25.631164 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.631142 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zpkt9\"" Jul 03 20:32:25.631825 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.631808 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.632947 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.632927 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 03 20:32:25.633301 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.633280 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 03 20:32:25.633404 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.633357 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j7nt4\"" Jul 03 20:32:25.633404 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.633372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.633516 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.633441 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 03 20:32:25.634907 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.634879 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 03 20:32:25.635166 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.635135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 03 20:32:25.635317 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.635298 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.635396 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.635298 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fxhqj\"" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.636863 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.636962 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.637019 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.636963 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.637235 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-swpw8\"" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.637699 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-sys-fs\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.637738 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-run-netns\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.637831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.637792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-ovn\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.638410 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.637929 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 03 20:32:25.638410 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.638345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-cni-bin\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.638410 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.638392 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-env-overrides\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.638580 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.638417 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.638580 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.638429 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-systemd-units\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.638950 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.638924 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 03 20:32:25.638950 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.638488 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639118 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.638996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzc9s\" (UniqueName: \"kubernetes.io/projected/5635349a-95d8-431d-94aa-c7831bd122a2-kube-api-access-xzc9s\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639118 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:25.639118 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639095 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-socket-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.639278 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639134 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxpcs\" (UniqueName: \"kubernetes.io/projected/db387eba-1f2e-4af5-91e9-cfab42e0d330-kube-api-access-pxpcs\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.639278 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639166 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-var-lib-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639278 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-etc-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639278 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0c6951c-6ab8-4bce-91c4-38078d6b91af-iptables-alerter-script\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.639508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639271 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbtgw\" (UniqueName: \"kubernetes.io/projected/c0c6951c-6ab8-4bce-91c4-38078d6b91af-kube-api-access-tbtgw\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.639508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-device-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.639508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639347 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-systemd\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-registration-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.639508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639423 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-etc-selinux\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.639508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639452 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639482 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-slash\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639513 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-log-socket\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639616 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-ovnkube-config\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-cni-netd\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639686 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0c6951c-6ab8-4bce-91c4-38078d6b91af-host-slash\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639719 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-kubelet\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-node-log\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5635349a-95d8-431d-94aa-c7831bd122a2-ovn-node-metrics-cert\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-ovnkube-script-lib\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9g4c\" (UniqueName: \"kubernetes.io/projected/68bc84f9-c740-4bff-880b-52f29d27cf05-kube-api-access-d9g4c\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:25.639948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.639945 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:25.640311 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.640005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-kubelet-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.640311 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.640128 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-798cm\"" Jul 03 20:32:25.640730 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.640707 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 03 20:32:25.641294 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.641256 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.641389 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.641327 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 03 20:32:25.641923 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.641909 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-68f6l\"" Jul 03 20:32:25.643073 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.643056 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.643606 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.643586 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 03 20:32:25.643679 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.643609 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 03 20:32:25.643740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.643675 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 03 20:32:25.643828 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.643750 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nbw95\"" Jul 03 20:32:25.643902 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.643814 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 03 20:32:25.644539 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.644519 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.644610 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.644583 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:25.646261 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.646244 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 03 20:32:25.646366 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.646350 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g9k56\"" Jul 03 20:32:25.652214 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.652197 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 03 20:32:25.706693 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.706666 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 03 20:32:25.726227 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:25.726174 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7ee0ea579cbfd49e6032150d18c00c.slice/crio-69237e30b13dc2028cc8ed3b764f5909390f4c9be223238d1d3f023dca820580 WatchSource:0}: Error finding container 69237e30b13dc2028cc8ed3b764f5909390f4c9be223238d1d3f023dca820580: Status 404 returned error can't find the container with id 69237e30b13dc2028cc8ed3b764f5909390f4c9be223238d1d3f023dca820580 Jul 03 20:32:25.726484 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:25.726459 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod171f32fba5ebc11b21af46d56737b784.slice/crio-00ef0e518ecfbcc4fad0f5f6aec205fc4c97084b9a98785a16f09888a2db5cc6 WatchSource:0}: Error finding container 00ef0e518ecfbcc4fad0f5f6aec205fc4c97084b9a98785a16f09888a2db5cc6: Status 404 returned error can't find the container with id 00ef0e518ecfbcc4fad0f5f6aec205fc4c97084b9a98785a16f09888a2db5cc6 Jul 03 20:32:25.730095 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.730077 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 03 20:32:25.731638 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.731618 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 20:32:25.740820 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.740685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-slash\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.740820 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.740730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-log-socket\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.740820 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.740798 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-slash\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.741047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.740829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-log-socket\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.741047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.740910 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-ovnkube-config\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.741047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.740938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.741047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.741047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-var-lib-kubelet\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.741371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-tuned\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.741371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-os-release\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.741371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0c6951c-6ab8-4bce-91c4-38078d6b91af-host-slash\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.741371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741245 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-cnibin\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.741371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0c6951c-6ab8-4bce-91c4-38078d6b91af-host-slash\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.741371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-multus-certs\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.741371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-kubelet\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.741740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-ovnkube-script-lib\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.741740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9g4c\" (UniqueName: \"kubernetes.io/projected/68bc84f9-c740-4bff-880b-52f29d27cf05-kube-api-access-d9g4c\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:25.741740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741471 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-kubelet\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.741740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-kubernetes\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.741740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741618 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-ovnkube-config\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.741740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-kubelet-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.741740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-ovn\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741780 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-ovn\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-env-overrides\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-kubelet-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741854 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.741982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzc9s\" (UniqueName: \"kubernetes.io/projected/5635349a-95d8-431d-94aa-c7831bd122a2-kube-api-access-xzc9s\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742039 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8530568-b428-4888-b148-e43cd575d1a5-agent-certs\") pod \"konnectivity-agent-6kblm\" (UID: \"a8530568-b428-4888-b148-e43cd575d1a5\") " pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742075 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-kubelet\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742100 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a08d2054-2cbe-4894-b30f-27fd2dca84ac-serviceca\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cnibin\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742162 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-env-overrides\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5635349a-95d8-431d-94aa-c7831bd122a2-ovnkube-script-lib\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxpcs\" (UniqueName: \"kubernetes.io/projected/db387eba-1f2e-4af5-91e9-cfab42e0d330-kube-api-access-pxpcs\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742208 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-run-ovn-kubernetes\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-var-lib-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742296 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8530568-b428-4888-b148-e43cd575d1a5-konnectivity-ca\") pod \"konnectivity-agent-6kblm\" (UID: \"a8530568-b428-4888-b148-e43cd575d1a5\") " pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-lib-modules\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742391 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-host\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742416 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf3231d3-dbaa-41b0-9161-dfb944d217cb-hosts-file\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742433 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-var-lib-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-device-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-systemd\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742579 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a08d2054-2cbe-4894-b30f-27fd2dca84ac-host\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-systemd\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9929s\" (UniqueName: \"kubernetes.io/projected/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-kube-api-access-9929s\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742664 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-device-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e898b144-956a-47c2-b36f-7b1348460296-cni-binary-copy\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f2mb\" (UniqueName: \"kubernetes.io/projected/bf3231d3-dbaa-41b0-9161-dfb944d217cb-kube-api-access-8f2mb\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.742789 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-registration-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742830 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-netns\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-registration-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742896 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-cni-multus\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742950 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.742995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-tmp\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743033 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3231d3-dbaa-41b0-9161-dfb944d217cb-tmp-dir\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743108 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-cni-netd\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743143 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-dbus\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743158 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-hostroot\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e898b144-956a-47c2-b36f-7b1348460296-multus-daemon-config\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743218 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-cni-netd\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743268 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-modprobe-d\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743307 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-node-log\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743335 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5635349a-95d8-431d-94aa-c7831bd122a2-ovn-node-metrics-cert\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.743483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743393 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-system-cni-dir\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743348 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-node-log\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743418 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-os-release\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysctl-d\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-sys-fs\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-run-netns\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743566 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-run-netns\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-cni-bin\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-sys-fs\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-systemd\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743685 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-host-cni-bin\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743687 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-sys\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743750 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-etc-kubernetes\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqw24\" (UniqueName: \"kubernetes.io/projected/e898b144-956a-47c2-b36f-7b1348460296-kube-api-access-hqw24\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-systemd-units\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:25.744191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.743975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwkb\" (UniqueName: \"kubernetes.io/projected/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-kube-api-access-mdwkb\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysctl-conf\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744096 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-system-cni-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744136 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-cni-bin\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.744228 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.744296 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs podName:68bc84f9-c740-4bff-880b-52f29d27cf05 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:26.244280978 +0000 UTC m=+3.153142399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs") pod "network-metrics-daemon-frps2" (UID: "68bc84f9-c740-4bff-880b-52f29d27cf05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744229 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-socket-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744315 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-socket-dir\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-etc-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0c6951c-6ab8-4bce-91c4-38078d6b91af-iptables-alerter-script\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbtgw\" (UniqueName: \"kubernetes.io/projected/c0c6951c-6ab8-4bce-91c4-38078d6b91af-kube-api-access-tbtgw\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-run\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744425 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ttx2\" (UniqueName: \"kubernetes.io/projected/a08d2054-2cbe-4894-b30f-27fd2dca84ac-kube-api-access-6ttx2\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-systemd-units\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744441 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-cni-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.744835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744465 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-conf-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-etc-selinux\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-kubelet-config\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysconfig\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-socket-dir-parent\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744592 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-k8s-cni-cncf-io\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744776 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/db387eba-1f2e-4af5-91e9-cfab42e0d330-etc-selinux\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744811 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-etc-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.744817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5635349a-95d8-431d-94aa-c7831bd122a2-run-openvswitch\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.745559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.745412 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0c6951c-6ab8-4bce-91c4-38078d6b91af-iptables-alerter-script\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.748336 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.748313 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5635349a-95d8-431d-94aa-c7831bd122a2-ovn-node-metrics-cert\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.753345 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.753267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" event={"ID":"171f32fba5ebc11b21af46d56737b784","Type":"ContainerStarted","Data":"00ef0e518ecfbcc4fad0f5f6aec205fc4c97084b9a98785a16f09888a2db5cc6"} Jul 03 20:32:25.754811 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.754787 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" event={"ID":"4e7ee0ea579cbfd49e6032150d18c00c","Type":"ContainerStarted","Data":"69237e30b13dc2028cc8ed3b764f5909390f4c9be223238d1d3f023dca820580"} Jul 03 20:32:25.758852 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.758831 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 20:32:25.758929 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.758863 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 20:32:25.758929 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.758874 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6wb27 for pod openshift-network-diagnostics/network-check-target-mrnzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:25.759023 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.758948 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27 podName:6fb7e64f-5def-41bf-bbdd-89f063a661bb nodeName:}" failed. No retries permitted until 2026-07-03 20:32:26.258925619 +0000 UTC m=+3.167787057 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6wb27" (UniqueName: "kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27") pod "network-check-target-mrnzz" (UID: "6fb7e64f-5def-41bf-bbdd-89f063a661bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:25.761047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.761021 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxpcs\" (UniqueName: \"kubernetes.io/projected/db387eba-1f2e-4af5-91e9-cfab42e0d330-kube-api-access-pxpcs\") pod \"aws-ebs-csi-driver-node-29wsb\" (UID: \"db387eba-1f2e-4af5-91e9-cfab42e0d330\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.761647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.761596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzc9s\" (UniqueName: \"kubernetes.io/projected/5635349a-95d8-431d-94aa-c7831bd122a2-kube-api-access-xzc9s\") pod \"ovnkube-node-wsv94\" (UID: \"5635349a-95d8-431d-94aa-c7831bd122a2\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.762799 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.762775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbtgw\" (UniqueName: \"kubernetes.io/projected/c0c6951c-6ab8-4bce-91c4-38078d6b91af-kube-api-access-tbtgw\") pod \"iptables-alerter-csn2w\" (UID: \"c0c6951c-6ab8-4bce-91c4-38078d6b91af\") " pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.763837 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.763815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9g4c\" (UniqueName: \"kubernetes.io/projected/68bc84f9-c740-4bff-880b-52f29d27cf05-kube-api-access-d9g4c\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:25.771187 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.771150 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9t475" Jul 03 20:32:25.778890 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.778862 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9t475" Jul 03 20:32:25.844863 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-kubelet-config\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.844863 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844866 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysconfig\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844884 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-socket-dir-parent\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-k8s-cni-cncf-io\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844924 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-var-lib-kubelet\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.844989 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysconfig\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.845088 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-k8s-cni-cncf-io\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-var-lib-kubelet\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845071 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-socket-dir-parent\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845079 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-tuned\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-kubelet-config\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:25.845160 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret podName:4b8c6c6b-9db0-4bb3-b254-a06244f079b8 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:26.345137299 +0000 UTC m=+3.253998741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret") pod "global-pull-secret-syncer-2lk2t" (UID: "4b8c6c6b-9db0-4bb3-b254-a06244f079b8") : object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-os-release\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-cnibin\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-multus-certs\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845282 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-kubernetes\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845287 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-os-release\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845301 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-cnibin\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845330 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-multus-certs\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845340 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8530568-b428-4888-b148-e43cd575d1a5-agent-certs\") pod \"konnectivity-agent-6kblm\" (UID: \"a8530568-b428-4888-b148-e43cd575d1a5\") " pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-kubelet\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845399 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a08d2054-2cbe-4894-b30f-27fd2dca84ac-serviceca\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845394 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-kubernetes\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.845614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845427 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cnibin\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845455 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8530568-b428-4888-b148-e43cd575d1a5-konnectivity-ca\") pod \"konnectivity-agent-6kblm\" (UID: \"a8530568-b428-4888-b148-e43cd575d1a5\") " pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845461 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-kubelet\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845480 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-lib-modules\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845506 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cnibin\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-host\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845569 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf3231d3-dbaa-41b0-9161-dfb944d217cb-hosts-file\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a08d2054-2cbe-4894-b30f-27fd2dca84ac-host\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-lib-modules\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9929s\" (UniqueName: \"kubernetes.io/projected/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-kube-api-access-9929s\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e898b144-956a-47c2-b36f-7b1348460296-cni-binary-copy\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845669 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f2mb\" (UniqueName: \"kubernetes.io/projected/bf3231d3-dbaa-41b0-9161-dfb944d217cb-kube-api-access-8f2mb\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-netns\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845697 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-host\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a08d2054-2cbe-4894-b30f-27fd2dca84ac-host\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-cni-multus\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845820 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-tmp\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.846512 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845846 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3231d3-dbaa-41b0-9161-dfb944d217cb-tmp-dir\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-dbus\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-hostroot\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e898b144-956a-47c2-b36f-7b1348460296-multus-daemon-config\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845962 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a08d2054-2cbe-4894-b30f-27fd2dca84ac-serviceca\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845977 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-modprobe-d\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.845671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf3231d3-dbaa-41b0-9161-dfb944d217cb-hosts-file\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-cni-multus\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-system-cni-dir\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846072 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-modprobe-d\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-os-release\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846088 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8530568-b428-4888-b148-e43cd575d1a5-konnectivity-ca\") pod \"konnectivity-agent-6kblm\" (UID: \"a8530568-b428-4888-b148-e43cd575d1a5\") " pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846113 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysctl-d\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-system-cni-dir\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-os-release\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846086 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-run-netns\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-hostroot\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.847513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846237 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysctl-d\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e898b144-956a-47c2-b36f-7b1348460296-cni-binary-copy\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846372 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-dbus\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846497 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf3231d3-dbaa-41b0-9161-dfb944d217cb-tmp-dir\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846605 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-systemd\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846682 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-sys\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-etc-kubernetes\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-systemd\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqw24\" (UniqueName: \"kubernetes.io/projected/e898b144-956a-47c2-b36f-7b1348460296-kube-api-access-hqw24\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846806 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwkb\" (UniqueName: \"kubernetes.io/projected/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-kube-api-access-mdwkb\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846835 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysctl-conf\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846863 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-system-cni-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-cni-bin\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846913 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e898b144-956a-47c2-b36f-7b1348460296-multus-daemon-config\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-run\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846949 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ttx2\" (UniqueName: \"kubernetes.io/projected/a08d2054-2cbe-4894-b30f-27fd2dca84ac-kube-api-access-6ttx2\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.848431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846950 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.846975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-cni-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-conf-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847012 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-sys\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847060 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-sysctl-conf\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847003 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-etc-kubernetes\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-cni-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-multus-conf-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-system-cni-dir\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847223 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e898b144-956a-47c2-b36f-7b1348460296-host-var-lib-cni-bin\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-run\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.847902 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-etc-tuned\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.848045 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8530568-b428-4888-b148-e43cd575d1a5-agent-certs\") pod \"konnectivity-agent-6kblm\" (UID: \"a8530568-b428-4888-b148-e43cd575d1a5\") " pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.849027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.848499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-tmp\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.858811 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.858733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqw24\" (UniqueName: \"kubernetes.io/projected/e898b144-956a-47c2-b36f-7b1348460296-kube-api-access-hqw24\") pod \"multus-s7zdt\" (UID: \"e898b144-956a-47c2-b36f-7b1348460296\") " pod="openshift-multus/multus-s7zdt" Jul 03 20:32:25.858935 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.858882 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f2mb\" (UniqueName: \"kubernetes.io/projected/bf3231d3-dbaa-41b0-9161-dfb944d217cb-kube-api-access-8f2mb\") pod \"node-resolver-p69p8\" (UID: \"bf3231d3-dbaa-41b0-9161-dfb944d217cb\") " pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:25.859778 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.859740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9929s\" (UniqueName: \"kubernetes.io/projected/b0c34774-4217-4ed0-b90d-4a03eb64fbd1-kube-api-access-9929s\") pod \"tuned-d4tpq\" (UID: \"b0c34774-4217-4ed0-b90d-4a03eb64fbd1\") " pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:25.859862 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.859773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ttx2\" (UniqueName: \"kubernetes.io/projected/a08d2054-2cbe-4894-b30f-27fd2dca84ac-kube-api-access-6ttx2\") pod \"node-ca-qzjfr\" (UID: \"a08d2054-2cbe-4894-b30f-27fd2dca84ac\") " pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:25.860152 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.860135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwkb\" (UniqueName: \"kubernetes.io/projected/023867ee-5a9b-4c79-a0f0-c0a67b57beb5-kube-api-access-mdwkb\") pod \"multus-additional-cni-plugins-dpshh\" (UID: \"023867ee-5a9b-4c79-a0f0-c0a67b57beb5\") " pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:25.947556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.947524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" Jul 03 20:32:25.957488 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:25.957456 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb387eba_1f2e_4af5_91e9_cfab42e0d330.slice/crio-644bcac9e7f09a2dedcb88b6831398b8550fdd993a44e210216f94869df24ef6 WatchSource:0}: Error finding container 644bcac9e7f09a2dedcb88b6831398b8550fdd993a44e210216f94869df24ef6: Status 404 returned error can't find the container with id 644bcac9e7f09a2dedcb88b6831398b8550fdd993a44e210216f94869df24ef6 Jul 03 20:32:25.958219 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.958200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:25.964192 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.964165 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-csn2w" Jul 03 20:32:25.966308 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:25.966287 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5635349a_95d8_431d_94aa_c7831bd122a2.slice/crio-f4b6fe621aa6893be0ac3a4bee913d4b3e0ada3ab9430ef661c2119b55a250aa WatchSource:0}: Error finding container f4b6fe621aa6893be0ac3a4bee913d4b3e0ada3ab9430ef661c2119b55a250aa: Status 404 returned error can't find the container with id f4b6fe621aa6893be0ac3a4bee913d4b3e0ada3ab9430ef661c2119b55a250aa Jul 03 20:32:25.972622 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:25.972593 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c6951c_6ab8_4bce_91c4_38078d6b91af.slice/crio-179d555f75f860a023cab0dce4593f061b6147ece4ace63a7ade12a013c68ce1 WatchSource:0}: Error finding container 179d555f75f860a023cab0dce4593f061b6147ece4ace63a7ade12a013c68ce1: Status 404 returned error can't find the container with id 179d555f75f860a023cab0dce4593f061b6147ece4ace63a7ade12a013c68ce1 Jul 03 20:32:25.987877 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:25.987843 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:25.996366 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:25.996341 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8530568_b428_4888_b148_e43cd575d1a5.slice/crio-e5c2e49e18e0e1248755c2faaea52db5d5f864055a07fa08a6ee35066dad00c2 WatchSource:0}: Error finding container e5c2e49e18e0e1248755c2faaea52db5d5f864055a07fa08a6ee35066dad00c2: Status 404 returned error can't find the container with id e5c2e49e18e0e1248755c2faaea52db5d5f864055a07fa08a6ee35066dad00c2 Jul 03 20:32:26.004911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.004880 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpshh" Jul 03 20:32:26.013072 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:26.013041 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod023867ee_5a9b_4c79_a0f0_c0a67b57beb5.slice/crio-cda1a6efdaa73551a8346f6d7d2d7f61bb855ff0e4d669f59d6ead10fe697f02 WatchSource:0}: Error finding container cda1a6efdaa73551a8346f6d7d2d7f61bb855ff0e4d669f59d6ead10fe697f02: Status 404 returned error can't find the container with id cda1a6efdaa73551a8346f6d7d2d7f61bb855ff0e4d669f59d6ead10fe697f02 Jul 03 20:32:26.034248 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.034215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" Jul 03 20:32:26.041432 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.041398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qzjfr" Jul 03 20:32:26.041736 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:26.041710 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0c34774_4217_4ed0_b90d_4a03eb64fbd1.slice/crio-282c4cb6ba61ff85f539a5bf724774fab2a187b3fefc1b5fe809e322c5c4019f WatchSource:0}: Error finding container 282c4cb6ba61ff85f539a5bf724774fab2a187b3fefc1b5fe809e322c5c4019f: Status 404 returned error can't find the container with id 282c4cb6ba61ff85f539a5bf724774fab2a187b3fefc1b5fe809e322c5c4019f Jul 03 20:32:26.048278 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.048255 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-s7zdt" Jul 03 20:32:26.049280 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:26.049258 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08d2054_2cbe_4894_b30f_27fd2dca84ac.slice/crio-6a46ec46e613d31dab8fd1da762f98fed7684160364c540d911c040ced314d1e WatchSource:0}: Error finding container 6a46ec46e613d31dab8fd1da762f98fed7684160364c540d911c040ced314d1e: Status 404 returned error can't find the container with id 6a46ec46e613d31dab8fd1da762f98fed7684160364c540d911c040ced314d1e Jul 03 20:32:26.054662 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.054642 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p69p8" Jul 03 20:32:26.056047 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:26.056017 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode898b144_956a_47c2_b36f_7b1348460296.slice/crio-09208b2b0d030988f1c67a3a28b8647158a903b8ba6688afa54389d6e59779e0 WatchSource:0}: Error finding container 09208b2b0d030988f1c67a3a28b8647158a903b8ba6688afa54389d6e59779e0: Status 404 returned error can't find the container with id 09208b2b0d030988f1c67a3a28b8647158a903b8ba6688afa54389d6e59779e0 Jul 03 20:32:26.063144 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:32:26.063121 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3231d3_dbaa_41b0_9161_dfb944d217cb.slice/crio-4c4aa1c7223543b8295d5dbd3c9a5a5053ac1c22fcdb5e1dd32bc8739e8626e7 WatchSource:0}: Error finding container 4c4aa1c7223543b8295d5dbd3c9a5a5053ac1c22fcdb5e1dd32bc8739e8626e7: Status 404 returned error can't find the container with id 4c4aa1c7223543b8295d5dbd3c9a5a5053ac1c22fcdb5e1dd32bc8739e8626e7 Jul 03 20:32:26.249424 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.249332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:26.249579 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.249489 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:26.249579 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.249559 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs podName:68bc84f9-c740-4bff-880b-52f29d27cf05 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:27.249540176 +0000 UTC m=+4.158401598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs") pod "network-metrics-daemon-frps2" (UID: "68bc84f9-c740-4bff-880b-52f29d27cf05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:26.350831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.350788 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:26.351025 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.350879 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:26.351095 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.351027 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:26.351146 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.351095 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret podName:4b8c6c6b-9db0-4bb3-b254-a06244f079b8 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:27.351075438 +0000 UTC m=+4.259936862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret") pod "global-pull-secret-syncer-2lk2t" (UID: "4b8c6c6b-9db0-4bb3-b254-a06244f079b8") : object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:26.351200 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.351190 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 20:32:26.351248 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.351209 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 20:32:26.351248 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.351223 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6wb27 for pod openshift-network-diagnostics/network-check-target-mrnzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:26.351337 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.351260 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27 podName:6fb7e64f-5def-41bf-bbdd-89f063a661bb nodeName:}" failed. No retries permitted until 2026-07-03 20:32:27.351249074 +0000 UTC m=+4.260110499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wb27" (UniqueName: "kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27") pod "network-check-target-mrnzz" (UID: "6fb7e64f-5def-41bf-bbdd-89f063a661bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:26.750393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.749882 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:26.750393 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:26.750022 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:26.782511 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.782467 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 20:27:26 +0000 UTC" deadline="2028-03-21 19:26:21.503841834 +0000 UTC" Jul 03 20:32:26.782511 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.782508 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15046h53m54.721338916s" Jul 03 20:32:26.794728 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.794666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"f4b6fe621aa6893be0ac3a4bee913d4b3e0ada3ab9430ef661c2119b55a250aa"} Jul 03 20:32:26.809407 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.809186 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" event={"ID":"db387eba-1f2e-4af5-91e9-cfab42e0d330","Type":"ContainerStarted","Data":"644bcac9e7f09a2dedcb88b6831398b8550fdd993a44e210216f94869df24ef6"} Jul 03 20:32:26.823142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.823027 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" event={"ID":"b0c34774-4217-4ed0-b90d-4a03eb64fbd1","Type":"ContainerStarted","Data":"282c4cb6ba61ff85f539a5bf724774fab2a187b3fefc1b5fe809e322c5c4019f"} Jul 03 20:32:26.840882 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.840788 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerStarted","Data":"cda1a6efdaa73551a8346f6d7d2d7f61bb855ff0e4d669f59d6ead10fe697f02"} Jul 03 20:32:26.871802 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.868592 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kblm" event={"ID":"a8530568-b428-4888-b148-e43cd575d1a5","Type":"ContainerStarted","Data":"e5c2e49e18e0e1248755c2faaea52db5d5f864055a07fa08a6ee35066dad00c2"} Jul 03 20:32:26.891183 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.891050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csn2w" event={"ID":"c0c6951c-6ab8-4bce-91c4-38078d6b91af","Type":"ContainerStarted","Data":"179d555f75f860a023cab0dce4593f061b6147ece4ace63a7ade12a013c68ce1"} Jul 03 20:32:26.928877 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.928795 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p69p8" event={"ID":"bf3231d3-dbaa-41b0-9161-dfb944d217cb","Type":"ContainerStarted","Data":"4c4aa1c7223543b8295d5dbd3c9a5a5053ac1c22fcdb5e1dd32bc8739e8626e7"} Jul 03 20:32:26.947964 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.947862 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7zdt" event={"ID":"e898b144-956a-47c2-b36f-7b1348460296","Type":"ContainerStarted","Data":"09208b2b0d030988f1c67a3a28b8647158a903b8ba6688afa54389d6e59779e0"} Jul 03 20:32:26.968350 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:26.968295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzjfr" event={"ID":"a08d2054-2cbe-4894-b30f-27fd2dca84ac","Type":"ContainerStarted","Data":"6a46ec46e613d31dab8fd1da762f98fed7684160364c540d911c040ced314d1e"} Jul 03 20:32:27.259780 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:27.259730 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:27.260001 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.259925 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:27.260163 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.260090 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs podName:68bc84f9-c740-4bff-880b-52f29d27cf05 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:29.259997302 +0000 UTC m=+6.168858730 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs") pod "network-metrics-daemon-frps2" (UID: "68bc84f9-c740-4bff-880b-52f29d27cf05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:27.360554 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:27.360511 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:27.360742 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:27.360599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:27.360827 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.360744 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:27.360827 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.360807 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret podName:4b8c6c6b-9db0-4bb3-b254-a06244f079b8 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:29.360788513 +0000 UTC m=+6.269649954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret") pod "global-pull-secret-syncer-2lk2t" (UID: "4b8c6c6b-9db0-4bb3-b254-a06244f079b8") : object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:27.361274 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.361255 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 20:32:27.361351 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.361280 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 20:32:27.361351 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.361294 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6wb27 for pod openshift-network-diagnostics/network-check-target-mrnzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:27.361351 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.361341 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27 podName:6fb7e64f-5def-41bf-bbdd-89f063a661bb nodeName:}" failed. No retries permitted until 2026-07-03 20:32:29.361325518 +0000 UTC m=+6.270186960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wb27" (UniqueName: "kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27") pod "network-check-target-mrnzz" (UID: "6fb7e64f-5def-41bf-bbdd-89f063a661bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:27.748979 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:27.748888 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:27.749149 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.749035 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:27.749243 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:27.749220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:27.749377 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:27.749353 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:27.782627 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:27.782586 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 20:27:26 +0000 UTC" deadline="2028-03-12 09:29:56.58243223 +0000 UTC" Jul 03 20:32:27.782627 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:27.782626 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14820h57m28.799811094s" Jul 03 20:32:28.750787 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:28.750717 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:28.750969 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:28.750929 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:29.277490 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:29.277371 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:29.278048 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.277535 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:29.278048 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.277607 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs podName:68bc84f9-c740-4bff-880b-52f29d27cf05 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:33.277586985 +0000 UTC m=+10.186448419 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs") pod "network-metrics-daemon-frps2" (UID: "68bc84f9-c740-4bff-880b-52f29d27cf05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:29.378200 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:29.378165 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:29.378389 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:29.378257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:29.378389 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.378358 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 20:32:29.378389 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.378384 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 20:32:29.378562 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.378398 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6wb27 for pod openshift-network-diagnostics/network-check-target-mrnzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:29.378562 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.378390 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:29.378562 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.378459 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27 podName:6fb7e64f-5def-41bf-bbdd-89f063a661bb nodeName:}" failed. No retries permitted until 2026-07-03 20:32:33.378439568 +0000 UTC m=+10.287301007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wb27" (UniqueName: "kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27") pod "network-check-target-mrnzz" (UID: "6fb7e64f-5def-41bf-bbdd-89f063a661bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:29.378562 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.378504 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret podName:4b8c6c6b-9db0-4bb3-b254-a06244f079b8 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:33.378484706 +0000 UTC m=+10.287346131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret") pod "global-pull-secret-syncer-2lk2t" (UID: "4b8c6c6b-9db0-4bb3-b254-a06244f079b8") : object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:29.749063 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:29.748975 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:29.749199 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.749158 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:29.749614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:29.749591 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:29.749733 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:29.749710 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:30.750493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:30.750457 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:30.750988 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:30.750603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:31.748913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:31.748833 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:31.749072 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:31.748983 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:31.749409 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:31.749389 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:31.749516 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:31.749494 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:32.748488 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:32.748454 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:32.749004 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:32.748592 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:33.314911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:33.314871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:33.315149 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.315127 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:33.315258 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.315220 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs podName:68bc84f9-c740-4bff-880b-52f29d27cf05 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:41.315193806 +0000 UTC m=+18.224055245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs") pod "network-metrics-daemon-frps2" (UID: "68bc84f9-c740-4bff-880b-52f29d27cf05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:33.416394 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:33.416343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:33.416768 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:33.416433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:33.416768 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.416569 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:33.416768 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.416638 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret podName:4b8c6c6b-9db0-4bb3-b254-a06244f079b8 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:41.416616986 +0000 UTC m=+18.325478410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret") pod "global-pull-secret-syncer-2lk2t" (UID: "4b8c6c6b-9db0-4bb3-b254-a06244f079b8") : object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:33.417189 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.417075 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 20:32:33.417189 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.417099 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 20:32:33.417189 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.417112 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6wb27 for pod openshift-network-diagnostics/network-check-target-mrnzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:33.417189 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.417162 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27 podName:6fb7e64f-5def-41bf-bbdd-89f063a661bb nodeName:}" failed. No retries permitted until 2026-07-03 20:32:41.417146468 +0000 UTC m=+18.326007911 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wb27" (UniqueName: "kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27") pod "network-check-target-mrnzz" (UID: "6fb7e64f-5def-41bf-bbdd-89f063a661bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:33.748807 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:33.748689 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:33.749302 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.748861 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:33.749302 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:33.748906 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:33.749302 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:33.749039 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:34.750465 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:34.749953 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:34.750465 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:34.750072 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:35.749479 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:35.749448 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:35.749650 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:35.749449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:35.749650 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:35.749580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:35.749789 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:35.749675 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:36.748911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:36.748876 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:36.749340 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:36.749004 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:37.748702 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:37.748654 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:37.748898 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:37.748751 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:37.748898 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:37.748825 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:37.748898 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:37.748879 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:38.748916 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:38.748867 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:38.749020 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:38.748996 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:39.749410 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:39.749372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:39.749890 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:39.749500 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:39.749890 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:39.749556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:39.749890 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:39.749658 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:40.748897 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:40.748864 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:40.749067 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:40.748992 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:41.381675 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:41.381632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:41.382188 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.381818 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:41.382188 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.381895 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs podName:68bc84f9-c740-4bff-880b-52f29d27cf05 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:57.381877656 +0000 UTC m=+34.290739079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs") pod "network-metrics-daemon-frps2" (UID: "68bc84f9-c740-4bff-880b-52f29d27cf05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:41.482493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:41.482453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:41.482665 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:41.482518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:41.482665 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.482634 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:41.482665 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.482647 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 20:32:41.482665 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.482665 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 20:32:41.482860 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.482680 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6wb27 for pod openshift-network-diagnostics/network-check-target-mrnzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:41.482860 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.482722 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret podName:4b8c6c6b-9db0-4bb3-b254-a06244f079b8 nodeName:}" failed. No retries permitted until 2026-07-03 20:32:57.4827049 +0000 UTC m=+34.391566326 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret") pod "global-pull-secret-syncer-2lk2t" (UID: "4b8c6c6b-9db0-4bb3-b254-a06244f079b8") : object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:41.482860 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.482740 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27 podName:6fb7e64f-5def-41bf-bbdd-89f063a661bb nodeName:}" failed. No retries permitted until 2026-07-03 20:32:57.48272888 +0000 UTC m=+34.391590317 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wb27" (UniqueName: "kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27") pod "network-check-target-mrnzz" (UID: "6fb7e64f-5def-41bf-bbdd-89f063a661bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:41.749404 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:41.749320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:41.749558 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:41.749320 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:41.749558 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.749458 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:41.749558 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:41.749513 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:42.748948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:42.748863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:42.749382 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:42.748992 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:43.748637 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:43.748599 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:43.748637 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:43.748634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:43.748892 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:43.748760 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:43.748892 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:43.748854 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:44.749429 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:44.749398 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:44.749880 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:44.749536 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:45.749082 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:45.749035 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:45.749082 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:45.749077 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:45.749303 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:45.749187 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:45.749303 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:45.749283 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:46.749421 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:46.749385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:46.749780 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:46.749499 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:47.020055 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:47.020017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" event={"ID":"4e7ee0ea579cbfd49e6032150d18c00c","Type":"ContainerStarted","Data":"fcffd368173083ba0d39db910cd91033313f6cebecf4222df23d8e3dd27f7fc2"} Jul 03 20:32:47.748737 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:47.748514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:47.748917 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:47.748863 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:47.748994 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:47.748556 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:47.749045 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:47.749012 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:48.031055 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.030969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-s7zdt" event={"ID":"e898b144-956a-47c2-b36f-7b1348460296","Type":"ContainerStarted","Data":"d2a6de27cc8c1a8cc331c37e8e8facfdcfbe637485776dac55bb077524e1d25b"} Jul 03 20:32:48.035022 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.034999 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:32:48.035402 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.035378 2578 generic.go:356] "Generic (PLEG): container finished" podID="5635349a-95d8-431d-94aa-c7831bd122a2" containerID="57c11c9beee3d99aef191a5b5cf8bdb27f8cdcb846aaeafeee44ad31f51df960" exitCode=1 Jul 03 20:32:48.035491 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.035449 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"a2e5e081ed67260f1c2fb1cd984964ab737c6854c0b9bf8d8c1dd416a8f8eba9"} Jul 03 20:32:48.035550 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.035533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"ce84e4a850dbcc33968f8a0f307ff4e8d6593a04f17e9588b903b1254ff74f12"} Jul 03 20:32:48.035614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.035595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"1bee0f2ee28519014725d14e34b42e45a09674b6424c05785bd1ce5d3c8cdc50"} Jul 03 20:32:48.035764 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.035676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"1843a255e6a29c7e384e0992a065a525ecaf385faa3c85374a7ee1e8c23a765b"} Jul 03 20:32:48.035764 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.035743 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerDied","Data":"57c11c9beee3d99aef191a5b5cf8bdb27f8cdcb846aaeafeee44ad31f51df960"} Jul 03 20:32:48.035870 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.035796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"95756bd131c06a17402e097fbe0c6da2f0ee8efa1909049860d16f7e002d8c41"} Jul 03 20:32:48.036935 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.036910 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" event={"ID":"b0c34774-4217-4ed0-b90d-4a03eb64fbd1","Type":"ContainerStarted","Data":"0e0d189b623a3cf7efd313f7e57533727100eb934f7b3214e2081228cf1f6da5"} Jul 03 20:32:48.048661 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.048617 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-s7zdt" podStartSLOduration=2.258239753 podStartE2EDuration="23.048603705s" totalImagesPullingTime="20.790363952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:48.048308766 +0000 UTC m=+24.957170208" watchObservedRunningTime="2026-07-03 20:32:48.048603705 +0000 UTC m=+24.957465147" Jul 03 20:32:48.078167 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.078115 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d4tpq" podStartSLOduration=2.289344937 podStartE2EDuration="23.078099104s" totalImagesPullingTime="20.788754167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:48.064964012 +0000 UTC m=+24.973825453" watchObservedRunningTime="2026-07-03 20:32:48.078099104 +0000 UTC m=+24.986960546" Jul 03 20:32:48.749585 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:48.749167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:48.749585 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:48.749507 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:49.041129 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.041043 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p69p8" event={"ID":"bf3231d3-dbaa-41b0-9161-dfb944d217cb","Type":"ContainerStarted","Data":"5501cd2b0d0b9418da83d243d4d2353865a6c748ebc35fe37b19c5da1dee4727"} Jul 03 20:32:49.042725 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.042697 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qzjfr" event={"ID":"a08d2054-2cbe-4894-b30f-27fd2dca84ac","Type":"ContainerStarted","Data":"8929b4901d54d42e5f6100dd04d0401c334969da8625563238187ff3f77ebfff"} Jul 03 20:32:49.044327 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.044286 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" event={"ID":"db387eba-1f2e-4af5-91e9-cfab42e0d330","Type":"ContainerStarted","Data":"a3a2d8309a9966bc0d2b3d7390a35001589b0ef7047a76db766d723527a3d145"} Jul 03 20:32:49.045890 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.045864 2578 generic.go:356] "Generic (PLEG): container finished" podID="171f32fba5ebc11b21af46d56737b784" containerID="3711ec297eebc0f24697d179faab8b8de75b69f290073dcb50258c9b87a92300" exitCode=0 Jul 03 20:32:49.046011 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.045949 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" event={"ID":"171f32fba5ebc11b21af46d56737b784","Type":"ContainerDied","Data":"3711ec297eebc0f24697d179faab8b8de75b69f290073dcb50258c9b87a92300"} Jul 03 20:32:49.047674 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.047652 2578 generic.go:356] "Generic (PLEG): container finished" podID="023867ee-5a9b-4c79-a0f0-c0a67b57beb5" containerID="27cd77eced3d6a502177ec8b7aeb704254b9500f87ee282229eb805e0bec5419" exitCode=0 Jul 03 20:32:49.047774 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.047717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerDied","Data":"27cd77eced3d6a502177ec8b7aeb704254b9500f87ee282229eb805e0bec5419"} Jul 03 20:32:49.049306 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.049270 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6kblm" event={"ID":"a8530568-b428-4888-b148-e43cd575d1a5","Type":"ContainerStarted","Data":"6bbe5cee45800bbab186560e253bcd5d9821edfdf53114d896c3f55f03079b84"} Jul 03 20:32:49.050855 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.050834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-csn2w" event={"ID":"c0c6951c-6ab8-4bce-91c4-38078d6b91af","Type":"ContainerStarted","Data":"0cafd167b37e79a6f3c0a007aa7a0b4501a6f1f0ebcb0ba5cee38e513a86fcaf"} Jul 03 20:32:49.060117 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.060062 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-211.ec2.internal" podStartSLOduration=23.060043781 podStartE2EDuration="23.060043781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:48.078234191 +0000 UTC m=+24.987095615" watchObservedRunningTime="2026-07-03 20:32:49.060043781 +0000 UTC m=+25.968905223" Jul 03 20:32:49.060260 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.060217 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p69p8" podStartSLOduration=3.312425547 podStartE2EDuration="24.060207338s" totalImagesPullingTime="20.747781791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:49.059455473 +0000 UTC m=+25.968316916" watchObservedRunningTime="2026-07-03 20:32:49.060207338 +0000 UTC m=+25.969068782" Jul 03 20:32:49.074964 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.074919 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6kblm" podStartSLOduration=3.2752459959999998 podStartE2EDuration="24.074904363s" totalImagesPullingTime="20.799658367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:49.07456233 +0000 UTC m=+25.983423772" watchObservedRunningTime="2026-07-03 20:32:49.074904363 +0000 UTC m=+25.983765805" Jul 03 20:32:49.129397 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.129351 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qzjfr" podStartSLOduration=3.382413701 podStartE2EDuration="24.129329074s" totalImagesPullingTime="20.746915373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:49.128839414 +0000 UTC m=+26.037700880" watchObservedRunningTime="2026-07-03 20:32:49.129329074 +0000 UTC m=+26.038190515" Jul 03 20:32:49.144092 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.144054 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-csn2w" podStartSLOduration=3.30734 podStartE2EDuration="24.144039053s" totalImagesPullingTime="20.836699053s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:49.143825835 +0000 UTC m=+26.052687277" watchObservedRunningTime="2026-07-03 20:32:49.144039053 +0000 UTC m=+26.052900494" Jul 03 20:32:49.150014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.149977 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:49.226520 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.226493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:49.327108 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.327079 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:49.343051 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.343025 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 03 20:32:49.427552 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.427503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:49.484663 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.484624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:49.749190 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.749107 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:49.749190 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.749151 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:49.749406 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:49.749259 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:49.749406 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:49.749387 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:49.851337 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.851209 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T20:32:49.343044953Z","UUID":"6188bb67-563c-4135-9b10-a9a025009560","Handler":null,"Name":"","Endpoint":""} Jul 03 20:32:49.852800 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.852778 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 03 20:32:49.852923 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:49.852821 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 03 20:32:50.056220 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:50.056138 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" event={"ID":"db387eba-1f2e-4af5-91e9-cfab42e0d330","Type":"ContainerStarted","Data":"5c59425c9fda0f4bbdef6f42ea0a6ff6411d3f31ff5d7fa9e838940e585ebcb8"} Jul 03 20:32:50.059142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:50.059104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" event={"ID":"171f32fba5ebc11b21af46d56737b784","Type":"ContainerStarted","Data":"0957df21961c34e337b0c977dd99423372e94c6dfda37e25f3af62811781fb34"} Jul 03 20:32:50.074329 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:50.074277 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-211.ec2.internal" podStartSLOduration=25.074259251 podStartE2EDuration="25.074259251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:50.074075363 +0000 UTC m=+26.982936806" watchObservedRunningTime="2026-07-03 20:32:50.074259251 +0000 UTC m=+26.983120694" Jul 03 20:32:50.748840 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:50.748761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:50.749005 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:50.748883 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:51.024148 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.024050 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:51.024793 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.024772 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:51.065143 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.065115 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:32:51.065599 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.065488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"d1f2b2ffb5abe2e851e65dea75e6bbfe7c4e600ace5c1d7f768a917e7942a294"} Jul 03 20:32:51.067721 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.067681 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" event={"ID":"db387eba-1f2e-4af5-91e9-cfab42e0d330","Type":"ContainerStarted","Data":"7aa998637a559768b79c848d98b1f4070971b03c13373e620b5c351220a2b69d"} Jul 03 20:32:51.068004 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.067979 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:51.068411 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.068382 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6kblm" Jul 03 20:32:51.085442 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.085389 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-29wsb" podStartSLOduration=3.283774407 podStartE2EDuration="26.085369086s" totalImagesPullingTime="22.801594679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:51.084992373 +0000 UTC m=+27.993853814" watchObservedRunningTime="2026-07-03 20:32:51.085369086 +0000 UTC m=+27.994230528" Jul 03 20:32:51.147241 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.147206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:51.749310 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.749272 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:51.749509 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:51.749273 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:51.749509 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:51.749422 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:51.749509 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:51.749460 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:52.748849 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:52.748761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:52.749281 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:52.748903 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:53.404179 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:53.404004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:53.505725 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:53.505668 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:53.605975 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:53.605898 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:53.748547 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:53.748517 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:53.748764 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:53.748639 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:53.748764 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:53.748718 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:53.748893 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:53.748803 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:53.756841 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:53.756820 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:54.075831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.075761 2578 generic.go:356] "Generic (PLEG): container finished" podID="023867ee-5a9b-4c79-a0f0-c0a67b57beb5" containerID="7dc92a19ce75296ea5e6f06518afe93dfbea4f627dbba7ea98736b59b7430cf6" exitCode=0 Jul 03 20:32:54.075998 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.075850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerDied","Data":"7dc92a19ce75296ea5e6f06518afe93dfbea4f627dbba7ea98736b59b7430cf6"} Jul 03 20:32:54.079198 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.079176 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:32:54.079514 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.079490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"cd89d7bb670416cb7c06ac6aec54baff62047dd2a5d2da4162160d994fbc2974"} Jul 03 20:32:54.079730 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.079714 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:54.079802 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.079787 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:54.079857 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.079837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:54.079972 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.079957 2578 scope.go:117] "RemoveContainer" containerID="57c11c9beee3d99aef191a5b5cf8bdb27f8cdcb846aaeafeee44ad31f51df960" Jul 03 20:32:54.096047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.096029 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:54.096303 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.096284 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:32:54.503182 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.502934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:54.575089 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.575060 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:54.749556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.749524 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:54.750056 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:54.749630 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:54.805504 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.805429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:54.912060 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:54.912027 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:55.009444 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.009387 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:55.076941 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.076915 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:55.085764 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.085746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:32:55.086200 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.086166 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" event={"ID":"5635349a-95d8-431d-94aa-c7831bd122a2","Type":"ContainerStarted","Data":"ea66c8e42c5453c2b28514b2e263604d5315fd4b40c40c22c8e02ff63c93b5f1"} Jul 03 20:32:55.116455 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.116395 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" podStartSLOduration=8.934528969 podStartE2EDuration="30.11637343s" totalImagesPullingTime="21.181844461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:32:55.114557213 +0000 UTC m=+32.023418656" watchObservedRunningTime="2026-07-03 20:32:55.11637343 +0000 UTC m=+32.025234878" Jul 03 20:32:55.359983 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.359905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:55.434224 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.434192 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2lk2t"] Jul 03 20:32:55.434430 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.434363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:55.434507 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:55.434471 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:55.435074 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.435054 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frps2"] Jul 03 20:32:55.435217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.435157 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:55.435309 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:55.435258 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:55.435569 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.435547 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mrnzz"] Jul 03 20:32:55.435632 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.435622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:55.435730 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:55.435713 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:55.457447 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.457419 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:55.531232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:55.531201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:56.090858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:56.090820 2578 generic.go:356] "Generic (PLEG): container finished" podID="023867ee-5a9b-4c79-a0f0-c0a67b57beb5" containerID="ed1de09007cacbc4135c8b32e9ca026e50e258177cd640659a3cd81b89d38c83" exitCode=0 Jul 03 20:32:56.091224 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:56.090894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerDied","Data":"ed1de09007cacbc4135c8b32e9ca026e50e258177cd640659a3cd81b89d38c83"} Jul 03 20:32:56.302968 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:56.302946 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p69p8_bf3231d3-dbaa-41b0-9161-dfb944d217cb/dns-node-resolver/0.log" Jul 03 20:32:56.748702 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:56.748611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:56.748702 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:56.748651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:56.748926 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:56.748765 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:56.748926 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:56.748903 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:57.094191 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.094160 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:57.095657 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.095637 2578 generic.go:356] "Generic (PLEG): container finished" podID="023867ee-5a9b-4c79-a0f0-c0a67b57beb5" containerID="180ec2e1dee477e14a1d49685a864b910ef5ca48896360d4e01fe3bcc9696495" exitCode=0 Jul 03 20:32:57.095801 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.095711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerDied","Data":"180ec2e1dee477e14a1d49685a864b910ef5ca48896360d4e01fe3bcc9696495"} Jul 03 20:32:57.150222 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.150183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:57.300217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.300144 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzjfr_a08d2054-2cbe-4894-b30f-27fd2dca84ac/node-ca/0.log" Jul 03 20:32:57.397273 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.397240 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:57.397441 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.397383 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:57.397485 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.397451 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs podName:68bc84f9-c740-4bff-880b-52f29d27cf05 nodeName:}" failed. No retries permitted until 2026-07-03 20:33:29.397427918 +0000 UTC m=+66.306289342 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs") pod "network-metrics-daemon-frps2" (UID: "68bc84f9-c740-4bff-880b-52f29d27cf05") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 03 20:32:57.497950 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.497915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:57.498103 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.497968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:57.498103 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.498051 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:57.498169 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.498110 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret podName:4b8c6c6b-9db0-4bb3-b254-a06244f079b8 nodeName:}" failed. No retries permitted until 2026-07-03 20:33:29.498093509 +0000 UTC m=+66.406954948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret") pod "global-pull-secret-syncer-2lk2t" (UID: "4b8c6c6b-9db0-4bb3-b254-a06244f079b8") : object "kube-system"/"original-pull-secret" not registered Jul 03 20:32:57.498169 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.498057 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 03 20:32:57.498169 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.498139 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 03 20:32:57.498169 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.498149 2578 projected.go:196] Error preparing data for projected volume kube-api-access-6wb27 for pod openshift-network-diagnostics/network-check-target-mrnzz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:57.498291 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.498189 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27 podName:6fb7e64f-5def-41bf-bbdd-89f063a661bb nodeName:}" failed. No retries permitted until 2026-07-03 20:33:29.498177397 +0000 UTC m=+66.407038840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6wb27" (UniqueName: "kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27") pod "network-check-target-mrnzz" (UID: "6fb7e64f-5def-41bf-bbdd-89f063a661bb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 03 20:32:57.748752 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.748664 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:57.748918 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:57.748810 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:32:57.967471 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:57.967433 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:32:58.749290 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:58.749258 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:32:58.749759 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:58.749304 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:32:58.749759 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:58.749408 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:32:58.749759 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:58.749555 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:32:59.748502 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:32:59.748467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:32:59.748710 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:32:59.748585 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:00.398252 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:00.398217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:00.497076 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:00.497045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:00.715092 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:00.714997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:00.749410 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:00.749118 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:00.749410 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:00.749166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:00.749410 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:00.749253 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:00.749410 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:00.749337 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:00.807795 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:00.807727 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:00.910525 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:00.910493 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:01.009253 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:01.009180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:01.107387 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:01.107170 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerStarted","Data":"ddf09c365da96424d155f1d1018b0fecce68876ac4186c48657f10ae5083fe6c"} Jul 03 20:33:01.148613 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:01.148579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:01.216348 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:01.216325 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:01.294526 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:01.294441 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:01.391086 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:01.391057 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:01.749222 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:01.749144 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:01.749564 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:01.749236 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:02.112095 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:02.112012 2578 generic.go:356] "Generic (PLEG): container finished" podID="023867ee-5a9b-4c79-a0f0-c0a67b57beb5" containerID="ddf09c365da96424d155f1d1018b0fecce68876ac4186c48657f10ae5083fe6c" exitCode=0 Jul 03 20:33:02.112095 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:02.112053 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerDied","Data":"ddf09c365da96424d155f1d1018b0fecce68876ac4186c48657f10ae5083fe6c"} Jul 03 20:33:02.396243 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:02.396131 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:02.748519 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:02.748491 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:02.748519 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:02.748523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:02.748746 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:02.748643 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:02.748804 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:02.748772 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:02.790587 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:02.790553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:02.984617 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:02.984576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:03.117908 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:03.117823 2578 generic.go:356] "Generic (PLEG): container finished" podID="023867ee-5a9b-4c79-a0f0-c0a67b57beb5" containerID="36fa84b5c91098c66db2795e6be137f3cbacf18acae424318f2efd08196efe52" exitCode=0 Jul 03 20:33:03.117908 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:03.117863 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerDied","Data":"36fa84b5c91098c66db2795e6be137f3cbacf18acae424318f2efd08196efe52"} Jul 03 20:33:03.205837 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:03.205813 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:03.599157 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:03.599125 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:03.749041 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:03.749013 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:03.749199 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:03.749102 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:04.123479 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.123450 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpshh" event={"ID":"023867ee-5a9b-4c79-a0f0-c0a67b57beb5","Type":"ContainerStarted","Data":"50bc2e04bc6575b987d97b229a0b4012a82dc59deb2aca50d90776a01bc51111"} Jul 03 20:33:04.167812 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.167767 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dpshh" podStartSLOduration=8.431555508 podStartE2EDuration="39.167751727s" totalImagesPullingTime="30.736196219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:04.165118415 +0000 UTC m=+41.073979858" watchObservedRunningTime="2026-07-03 20:33:04.167751727 +0000 UTC m=+41.076613147" Jul 03 20:33:04.396361 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.396275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:04.476749 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.476720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:04.749408 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.749379 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:04.749547 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:04.749472 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:04.749604 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.749558 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:04.749668 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:04.749650 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:04.790486 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.790453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:04.984518 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:04.984487 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:05.197439 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:05.197408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:05.297829 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:05.297797 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:05.392378 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:05.392347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:05.749091 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:05.749069 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:05.749258 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:05.749167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:06.112234 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.112158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:06.233240 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.233207 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:06.405540 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.405469 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:06.522205 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.522175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:06.748809 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.748786 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:06.748967 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.748788 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:06.748967 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:06.748888 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:06.749039 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:06.748993 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:06.804887 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.804857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:06.969971 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:06.969940 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:07.069794 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:07.069675 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:07.182091 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:07.182060 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:07.276923 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:07.276889 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:07.390950 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:07.390877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:07.749228 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:07.749199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:07.749379 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:07.749305 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:07.781397 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:07.781373 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:07.972661 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:07.972630 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:08.588345 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:08.588299 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:08.748965 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:08.748928 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:08.749124 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:08.749038 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:08.749124 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:08.749098 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:08.749237 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:08.749217 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:08.784274 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:08.784242 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:08.852019 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:08.851941 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:08.990613 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:08.990584 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:09.182014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:09.181986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:09.383056 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:09.383028 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:09.748633 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:09.748605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:09.749029 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:09.748709 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:09.958248 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:09.958216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:10.379910 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:10.379876 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:10.749019 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:10.748990 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:10.749558 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:10.749032 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:10.749558 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:10.749121 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:10.749558 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:10.749243 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:10.784258 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:10.784223 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:10.981705 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:10.981667 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:11.198427 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:11.198401 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:11.582440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:11.582363 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:11.748753 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:11.748706 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:11.748951 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:11.748837 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:11.791060 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:11.791029 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:12.749468 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:12.749429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:12.749644 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:12.749550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:12.749644 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:12.749606 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:12.749764 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:12.749732 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:13.748918 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:13.748884 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:13.749290 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:13.748986 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:14.751336 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:14.751310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:14.751710 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:14.751424 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:14.751710 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:14.751453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:14.751710 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:14.751525 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:15.387481 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:15.387452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:15.488264 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:15.488234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:15.748808 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:15.748783 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:15.748984 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:15.748876 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:16.748827 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:16.748795 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:16.748827 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:16.748831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:16.749447 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:16.748916 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:16.749447 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:16.749044 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:17.749003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:17.748966 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:17.749362 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:17.749063 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mrnzz" podUID="6fb7e64f-5def-41bf-bbdd-89f063a661bb" Jul 03 20:33:18.323747 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.323712 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:18.417913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.417883 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:18.517701 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.517651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:18.611766 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.611647 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:18.748730 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.748676 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:18.748900 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.748680 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:18.748900 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:18.748809 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2lk2t" podUID="4b8c6c6b-9db0-4bb3-b254-a06244f079b8" Jul 03 20:33:18.748900 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:18.748887 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-frps2" podUID="68bc84f9-c740-4bff-880b-52f29d27cf05" Jul 03 20:33:18.882717 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.882629 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-211.ec2.internal" event="NodeReady" Jul 03 20:33:18.883103 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.882763 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 03 20:33:18.960130 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.960099 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d48rr"] Jul 03 20:33:18.981250 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.981222 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j89p9"] Jul 03 20:33:18.981392 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.981343 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:18.987199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.987174 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 03 20:33:18.987630 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.987607 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tfjxf\"" Jul 03 20:33:18.989085 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.989062 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 03 20:33:18.997201 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.997180 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d48rr"] Jul 03 20:33:18.997299 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.997212 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j89p9"] Jul 03 20:33:18.997299 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:18.997288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.000733 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.000714 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 03 20:33:19.000929 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.000913 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 03 20:33:19.000929 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.000926 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-498s6\"" Jul 03 20:33:19.001029 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.000987 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 03 20:33:19.001858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.001842 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 03 20:33:19.060205 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.060172 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6mmvh"] Jul 03 20:33:19.063787 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.063768 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de36a72b-d1c3-4443-b335-87025482c364-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.063873 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.063793 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e63a2b-03c0-426c-991a-9adcdebc0fe8-metrics-tls\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.063873 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.063817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e63a2b-03c0-426c-991a-9adcdebc0fe8-config-volume\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.063873 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.063836 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de36a72b-d1c3-4443-b335-87025482c364-crio-socket\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.063873 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.063857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e63a2b-03c0-426c-991a-9adcdebc0fe8-tmp-dir\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.064014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.063929 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7wl\" (UniqueName: \"kubernetes.io/projected/de36a72b-d1c3-4443-b335-87025482c364-kube-api-access-fx7wl\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.064014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.063982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de36a72b-d1c3-4443-b335-87025482c364-data-volume\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.064014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.064007 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htxnq\" (UniqueName: \"kubernetes.io/projected/65e63a2b-03c0-426c-991a-9adcdebc0fe8-kube-api-access-htxnq\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.064223 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.064029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de36a72b-d1c3-4443-b335-87025482c364-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.081440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.081415 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mmvh"] Jul 03 20:33:19.081566 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.081501 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.084206 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.084187 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jqhvm\"" Jul 03 20:33:19.084607 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.084595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 03 20:33:19.084762 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.084745 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 03 20:33:19.084820 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.084780 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 03 20:33:19.164985 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.164911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de36a72b-d1c3-4443-b335-87025482c364-data-volume\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.164985 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.164941 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htxnq\" (UniqueName: \"kubernetes.io/projected/65e63a2b-03c0-426c-991a-9adcdebc0fe8-kube-api-access-htxnq\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.164985 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.164964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de36a72b-d1c3-4443-b335-87025482c364-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.165235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165005 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de36a72b-d1c3-4443-b335-87025482c364-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.165235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165023 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e63a2b-03c0-426c-991a-9adcdebc0fe8-metrics-tls\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.165235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165043 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e63a2b-03c0-426c-991a-9adcdebc0fe8-config-volume\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.165235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de36a72b-d1c3-4443-b335-87025482c364-crio-socket\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.165235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165099 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784a7e9f-7d55-4c90-b24d-9e75520b1555-cert\") pod \"ingress-canary-6mmvh\" (UID: \"784a7e9f-7d55-4c90-b24d-9e75520b1555\") " pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.165235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de36a72b-d1c3-4443-b335-87025482c364-crio-socket\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.165235 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165214 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckbzm\" (UniqueName: \"kubernetes.io/projected/784a7e9f-7d55-4c90-b24d-9e75520b1555-kube-api-access-ckbzm\") pod \"ingress-canary-6mmvh\" (UID: \"784a7e9f-7d55-4c90-b24d-9e75520b1555\") " pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.165588 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e63a2b-03c0-426c-991a-9adcdebc0fe8-tmp-dir\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.165588 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7wl\" (UniqueName: \"kubernetes.io/projected/de36a72b-d1c3-4443-b335-87025482c364-kube-api-access-fx7wl\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.165588 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de36a72b-d1c3-4443-b335-87025482c364-data-volume\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.165588 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65e63a2b-03c0-426c-991a-9adcdebc0fe8-tmp-dir\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.165808 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/65e63a2b-03c0-426c-991a-9adcdebc0fe8-config-volume\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.165808 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.165753 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de36a72b-d1c3-4443-b335-87025482c364-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.168981 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.168965 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de36a72b-d1c3-4443-b335-87025482c364-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.169029 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.168971 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/65e63a2b-03c0-426c-991a-9adcdebc0fe8-metrics-tls\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.173709 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.173669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htxnq\" (UniqueName: \"kubernetes.io/projected/65e63a2b-03c0-426c-991a-9adcdebc0fe8-kube-api-access-htxnq\") pod \"dns-default-d48rr\" (UID: \"65e63a2b-03c0-426c-991a-9adcdebc0fe8\") " pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.174091 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.174074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7wl\" (UniqueName: \"kubernetes.io/projected/de36a72b-d1c3-4443-b335-87025482c364-kube-api-access-fx7wl\") pod \"insights-runtime-extractor-j89p9\" (UID: \"de36a72b-d1c3-4443-b335-87025482c364\") " pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.198376 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.198350 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:19.266637 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.266603 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784a7e9f-7d55-4c90-b24d-9e75520b1555-cert\") pod \"ingress-canary-6mmvh\" (UID: \"784a7e9f-7d55-4c90-b24d-9e75520b1555\") " pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.266637 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.266640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckbzm\" (UniqueName: \"kubernetes.io/projected/784a7e9f-7d55-4c90-b24d-9e75520b1555-kube-api-access-ckbzm\") pod \"ingress-canary-6mmvh\" (UID: \"784a7e9f-7d55-4c90-b24d-9e75520b1555\") " pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.268969 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.268946 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/784a7e9f-7d55-4c90-b24d-9e75520b1555-cert\") pod \"ingress-canary-6mmvh\" (UID: \"784a7e9f-7d55-4c90-b24d-9e75520b1555\") " pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.271375 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.271356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:19.274340 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.274317 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckbzm\" (UniqueName: \"kubernetes.io/projected/784a7e9f-7d55-4c90-b24d-9e75520b1555-kube-api-access-ckbzm\") pod \"ingress-canary-6mmvh\" (UID: \"784a7e9f-7d55-4c90-b24d-9e75520b1555\") " pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.294725 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.294674 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:19.305825 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.305802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j89p9" Jul 03 20:33:19.390403 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.390372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6mmvh" Jul 03 20:33:19.521655 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.521551 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j89p9"] Jul 03 20:33:19.525256 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:19.525226 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde36a72b_d1c3_4443_b335_87025482c364.slice/crio-b8a1458c2da8793abd275f91fd26c352a1ee564ec0746ed11a8235cddcafde23 WatchSource:0}: Error finding container b8a1458c2da8793abd275f91fd26c352a1ee564ec0746ed11a8235cddcafde23: Status 404 returned error can't find the container with id b8a1458c2da8793abd275f91fd26c352a1ee564ec0746ed11a8235cddcafde23 Jul 03 20:33:19.528907 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.528877 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d48rr"] Jul 03 20:33:19.532046 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:19.532004 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e63a2b_03c0_426c_991a_9adcdebc0fe8.slice/crio-1ab6e48a3606f137a59f1358c50edb6f628b6e6d2299521ed54ec6cfdeecc996 WatchSource:0}: Error finding container 1ab6e48a3606f137a59f1358c50edb6f628b6e6d2299521ed54ec6cfdeecc996: Status 404 returned error can't find the container with id 1ab6e48a3606f137a59f1358c50edb6f628b6e6d2299521ed54ec6cfdeecc996 Jul 03 20:33:19.566421 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.566392 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6mmvh"] Jul 03 20:33:19.569312 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:19.569281 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784a7e9f_7d55_4c90_b24d_9e75520b1555.slice/crio-07a0642313a2e0995e1c4ed5d6fee70ca770de7b624fcfb52420288d522a5fe4 WatchSource:0}: Error finding container 07a0642313a2e0995e1c4ed5d6fee70ca770de7b624fcfb52420288d522a5fe4: Status 404 returned error can't find the container with id 07a0642313a2e0995e1c4ed5d6fee70ca770de7b624fcfb52420288d522a5fe4 Jul 03 20:33:19.749309 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.749277 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:19.752355 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.752327 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 20:33:19.752549 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.752533 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 20:33:19.752640 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:19.752626 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k9k4n\"" Jul 03 20:33:20.161522 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.161376 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j89p9" event={"ID":"de36a72b-d1c3-4443-b335-87025482c364","Type":"ContainerStarted","Data":"b8a1458c2da8793abd275f91fd26c352a1ee564ec0746ed11a8235cddcafde23"} Jul 03 20:33:20.163765 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.163404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d48rr" event={"ID":"65e63a2b-03c0-426c-991a-9adcdebc0fe8","Type":"ContainerStarted","Data":"1ab6e48a3606f137a59f1358c50edb6f628b6e6d2299521ed54ec6cfdeecc996"} Jul 03 20:33:20.165459 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.165433 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mmvh" event={"ID":"784a7e9f-7d55-4c90-b24d-9e75520b1555","Type":"ContainerStarted","Data":"07a0642313a2e0995e1c4ed5d6fee70ca770de7b624fcfb52420288d522a5fe4"} Jul 03 20:33:20.750988 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.749810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:20.750988 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.750663 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:20.754154 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.754128 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 20:33:20.754296 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.754167 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9tq75\"" Jul 03 20:33:20.754911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:20.754426 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 20:33:21.795846 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.795810 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5979fcdf8b-bh5f5"] Jul 03 20:33:21.797833 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.797810 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.801101 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.801373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.801409 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.801641 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6bbjr\"" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.802020 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.802093 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.802107 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 03 20:33:21.802239 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.802165 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 03 20:33:21.808175 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.808147 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5979fcdf8b-bh5f5"] Jul 03 20:33:21.887951 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.887910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-serving-cert\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.888142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.887982 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-oauth-config\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.888142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.888017 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-oauth-serving-cert\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.888142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.888056 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6svrz\" (UniqueName: \"kubernetes.io/projected/61d2d8ad-8edf-4269-9660-c63ef7b62eef-kube-api-access-6svrz\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.888142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.888103 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-config\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.888142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.888124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-service-ca\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.989540 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.989497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6svrz\" (UniqueName: \"kubernetes.io/projected/61d2d8ad-8edf-4269-9660-c63ef7b62eef-kube-api-access-6svrz\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.989753 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.989556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-config\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.989753 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.989586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-service-ca\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.989753 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.989656 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-serving-cert\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.989753 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.989723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-oauth-config\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.989973 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.989885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-oauth-serving-cert\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.990458 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.990432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-config\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.990564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.990519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-service-ca\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.990624 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.990563 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-oauth-serving-cert\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.992543 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.992519 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-serving-cert\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.992650 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.992542 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-oauth-config\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:21.997614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:21.997595 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6svrz\" (UniqueName: \"kubernetes.io/projected/61d2d8ad-8edf-4269-9660-c63ef7b62eef-kube-api-access-6svrz\") pod \"console-5979fcdf8b-bh5f5\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:22.110193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.110102 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:22.222601 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.222567 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:22.391361 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.391281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:22.393745 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.393720 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f"] Jul 03 20:33:22.396130 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.396111 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:22.399175 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.399153 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 03 20:33:22.399324 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.399308 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qlwql\"" Jul 03 20:33:22.406263 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.406242 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f"] Jul 03 20:33:22.486489 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.486449 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:22.494382 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.494356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/929bae0d-82b6-41d9-87bc-56bb07b249d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vjg5f\" (UID: \"929bae0d-82b6-41d9-87bc-56bb07b249d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:22.586110 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.586075 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:22.595090 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.595068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/929bae0d-82b6-41d9-87bc-56bb07b249d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vjg5f\" (UID: \"929bae0d-82b6-41d9-87bc-56bb07b249d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:22.595229 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:22.595203 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 03 20:33:22.595303 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:22.595292 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/929bae0d-82b6-41d9-87bc-56bb07b249d8-tls-certificates podName:929bae0d-82b6-41d9-87bc-56bb07b249d8 nodeName:}" failed. No retries permitted until 2026-07-03 20:33:23.095270626 +0000 UTC m=+60.004132063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/929bae0d-82b6-41d9-87bc-56bb07b249d8-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-vjg5f" (UID: "929bae0d-82b6-41d9-87bc-56bb07b249d8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 03 20:33:22.685439 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.685408 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:22.745104 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:22.745070 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:23.100294 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:23.100215 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/929bae0d-82b6-41d9-87bc-56bb07b249d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vjg5f\" (UID: \"929bae0d-82b6-41d9-87bc-56bb07b249d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:23.102994 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:23.102959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/929bae0d-82b6-41d9-87bc-56bb07b249d8-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vjg5f\" (UID: \"929bae0d-82b6-41d9-87bc-56bb07b249d8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:23.305381 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:23.305327 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:23.784524 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:23.784497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:23.846876 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:23.846803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:24.710322 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:24.710207 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f"] Jul 03 20:33:24.716031 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:24.716005 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod929bae0d_82b6_41d9_87bc_56bb07b249d8.slice/crio-9b7b2610a3f7292205ef864dc54aad18f4f8e822e079580c0b862fb64689dfa9 WatchSource:0}: Error finding container 9b7b2610a3f7292205ef864dc54aad18f4f8e822e079580c0b862fb64689dfa9: Status 404 returned error can't find the container with id 9b7b2610a3f7292205ef864dc54aad18f4f8e822e079580c0b862fb64689dfa9 Jul 03 20:33:24.732557 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:24.732153 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5979fcdf8b-bh5f5"] Jul 03 20:33:24.744115 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:24.744069 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d2d8ad_8edf_4269_9660_c63ef7b62eef.slice/crio-979095170aec0135cdbf19aec87b679bbf9204ba5ddb20aea2e026fcc1146bd3 WatchSource:0}: Error finding container 979095170aec0135cdbf19aec87b679bbf9204ba5ddb20aea2e026fcc1146bd3: Status 404 returned error can't find the container with id 979095170aec0135cdbf19aec87b679bbf9204ba5ddb20aea2e026fcc1146bd3 Jul 03 20:33:25.180958 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.180918 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6mmvh" event={"ID":"784a7e9f-7d55-4c90-b24d-9e75520b1555","Type":"ContainerStarted","Data":"aee07548872a1c042526cdd6753f8924a3f9dace928001b3a6acce3b9846f15a"} Jul 03 20:33:25.182198 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.182169 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" event={"ID":"929bae0d-82b6-41d9-87bc-56bb07b249d8","Type":"ContainerStarted","Data":"9b7b2610a3f7292205ef864dc54aad18f4f8e822e079580c0b862fb64689dfa9"} Jul 03 20:33:25.183859 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.183834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j89p9" event={"ID":"de36a72b-d1c3-4443-b335-87025482c364","Type":"ContainerStarted","Data":"7fe2cf5cb1c91a6705a7241bc4b813ac67d9734d23d87e51c7531c4f98c5d176"} Jul 03 20:33:25.185786 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.185762 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d48rr" event={"ID":"65e63a2b-03c0-426c-991a-9adcdebc0fe8","Type":"ContainerStarted","Data":"dfd7b8f82a14233f296a545c0b74aea690b7aa6d334ac218707efa40a471ef25"} Jul 03 20:33:25.185891 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.185807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d48rr" event={"ID":"65e63a2b-03c0-426c-991a-9adcdebc0fe8","Type":"ContainerStarted","Data":"f886b9af7b048df996fb5b5568b48b2a5816b759cd60e844cce3a20a30e2f342"} Jul 03 20:33:25.185964 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.185893 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:25.186970 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.186948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5979fcdf8b-bh5f5" event={"ID":"61d2d8ad-8edf-4269-9660-c63ef7b62eef","Type":"ContainerStarted","Data":"979095170aec0135cdbf19aec87b679bbf9204ba5ddb20aea2e026fcc1146bd3"} Jul 03 20:33:25.202386 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.202336 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6mmvh" podStartSLOduration=1.20980847 podStartE2EDuration="6.202320444s" totalImagesPullingTime="4.992511974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:25.202235661 +0000 UTC m=+62.111097104" watchObservedRunningTime="2026-07-03 20:33:25.202320444 +0000 UTC m=+62.111181882" Jul 03 20:33:25.223830 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.223778 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d48rr" podStartSLOduration=2.196732083 podStartE2EDuration="7.223757742s" totalImagesPullingTime="5.027025659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:25.222544798 +0000 UTC m=+62.131406252" watchObservedRunningTime="2026-07-03 20:33:25.223757742 +0000 UTC m=+62.132619188" Jul 03 20:33:25.281118 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.281081 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:25.385736 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.385702 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:25.595339 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.595288 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:25.698188 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:25.698154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:26.106957 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.106925 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsv94" Jul 03 20:33:26.198015 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.197523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" event={"ID":"929bae0d-82b6-41d9-87bc-56bb07b249d8","Type":"ContainerStarted","Data":"681237ae863e7812b8ca9ebb3e3a3f09d51ece701d2d8f69e4a68a8e1028df88"} Jul 03 20:33:26.198015 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.197794 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:26.200386 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.200358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j89p9" event={"ID":"de36a72b-d1c3-4443-b335-87025482c364","Type":"ContainerStarted","Data":"91137a9c940e77325e7e74568699ee7ef882bf3e3305d359c80c5ae0f89b3308"} Jul 03 20:33:26.204267 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.204246 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" Jul 03 20:33:26.225995 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.225727 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vjg5f" podStartSLOduration=2.977891019 podStartE2EDuration="4.225706989s" totalImagesPullingTime="1.24781597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:26.224856407 +0000 UTC m=+63.133717851" watchObservedRunningTime="2026-07-03 20:33:26.225706989 +0000 UTC m=+63.134568431" Jul 03 20:33:26.259558 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.259499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:26.359255 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.359196 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:26.461456 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.461424 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:26.469250 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.469221 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b"] Jul 03 20:33:26.481383 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.481312 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b"] Jul 03 20:33:26.481511 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.481431 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.485366 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.485332 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-p6f45\"" Jul 03 20:33:26.485516 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.485498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 03 20:33:26.485581 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.485563 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 03 20:33:26.485647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.485626 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 03 20:33:26.485700 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.485634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 03 20:33:26.485840 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.485824 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 03 20:33:26.530643 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.530601 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc5c94e-c945-4d26-8f84-abd5711b8732-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.530643 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.530643 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc5c94e-c945-4d26-8f84-abd5711b8732-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.530884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.530773 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fc5c94e-c945-4d26-8f84-abd5711b8732-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.530884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.530803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh55n\" (UniqueName: \"kubernetes.io/projected/0fc5c94e-c945-4d26-8f84-abd5711b8732-kube-api-access-gh55n\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.532482 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.532452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:26.631791 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.631754 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fc5c94e-c945-4d26-8f84-abd5711b8732-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.631988 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.631803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh55n\" (UniqueName: \"kubernetes.io/projected/0fc5c94e-c945-4d26-8f84-abd5711b8732-kube-api-access-gh55n\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.631988 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.631842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc5c94e-c945-4d26-8f84-abd5711b8732-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.631988 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.631869 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc5c94e-c945-4d26-8f84-abd5711b8732-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.632630 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.632604 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0fc5c94e-c945-4d26-8f84-abd5711b8732-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.634793 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.634768 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0fc5c94e-c945-4d26-8f84-abd5711b8732-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.634996 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.634973 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0fc5c94e-c945-4d26-8f84-abd5711b8732-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.649496 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.649469 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh55n\" (UniqueName: \"kubernetes.io/projected/0fc5c94e-c945-4d26-8f84-abd5711b8732-kube-api-access-gh55n\") pod \"prometheus-operator-567f7b8b7c-gbf9b\" (UID: \"0fc5c94e-c945-4d26-8f84-abd5711b8732\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:26.676610 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.676540 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:26.793281 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:26.793202 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" Jul 03 20:33:27.438060 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.437957 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:27.578256 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.578224 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5764894b74-9b5fp"] Jul 03 20:33:27.584206 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.584180 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.593813 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.593787 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 03 20:33:27.594954 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.594932 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5764894b74-9b5fp"] Jul 03 20:33:27.641276 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.641231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-trusted-ca-bundle\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.641450 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.641295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-oauth-config\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.641450 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.641321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-oauth-serving-cert\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.641450 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.641366 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btdv9\" (UniqueName: \"kubernetes.io/projected/6c0915e3-471e-4f06-95fd-d75e42d526f5-kube-api-access-btdv9\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.641625 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.641515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-serving-cert\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.641625 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.641612 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-config\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.641743 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.641660 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-service-ca\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.742325 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.742248 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-config\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.742325 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.742293 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-service-ca\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.742325 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.742319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-trusted-ca-bundle\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.742584 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.742350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-oauth-config\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.742584 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.742372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-oauth-serving-cert\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.742584 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.742475 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btdv9\" (UniqueName: \"kubernetes.io/projected/6c0915e3-471e-4f06-95fd-d75e42d526f5-kube-api-access-btdv9\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.742584 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.742550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-serving-cert\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.743079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.743055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-config\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.743179 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.743054 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-oauth-serving-cert\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.743336 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.743319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-service-ca\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.743642 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.743619 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-trusted-ca-bundle\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.745141 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.745116 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-oauth-config\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.745330 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.745306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-serving-cert\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.751042 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.751022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btdv9\" (UniqueName: \"kubernetes.io/projected/6c0915e3-471e-4f06-95fd-d75e42d526f5-kube-api-access-btdv9\") pod \"console-5764894b74-9b5fp\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.802767 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.802729 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:27.894663 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.894629 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:27.902797 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:27.902772 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:28.528447 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:28.528397 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:28.623545 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:28.623511 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:28.855385 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:28.855199 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b"] Jul 03 20:33:28.857992 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:28.857961 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fc5c94e_c945_4d26_8f84_abd5711b8732.slice/crio-a171fd4ccca30629ce3bb3a2b9cba7e234325738d12130b1a94e7fe8f645de1e WatchSource:0}: Error finding container a171fd4ccca30629ce3bb3a2b9cba7e234325738d12130b1a94e7fe8f645de1e: Status 404 returned error can't find the container with id a171fd4ccca30629ce3bb3a2b9cba7e234325738d12130b1a94e7fe8f645de1e Jul 03 20:33:28.876500 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:28.876470 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5764894b74-9b5fp"] Jul 03 20:33:28.880259 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:28.880230 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0915e3_471e_4f06_95fd_d75e42d526f5.slice/crio-43fd937ac868832121fa5973b6fd77b21799b69f94ffa5378a73c4ca8836d24d WatchSource:0}: Error finding container 43fd937ac868832121fa5973b6fd77b21799b69f94ffa5378a73c4ca8836d24d: Status 404 returned error can't find the container with id 43fd937ac868832121fa5973b6fd77b21799b69f94ffa5378a73c4ca8836d24d Jul 03 20:33:29.212843 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.212800 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j89p9" event={"ID":"de36a72b-d1c3-4443-b335-87025482c364","Type":"ContainerStarted","Data":"70c300f68ab846da94a75ad8245c3ccba788e8e99d41c8566c39f5578427f214"} Jul 03 20:33:29.214456 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.214432 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5979fcdf8b-bh5f5" event={"ID":"61d2d8ad-8edf-4269-9660-c63ef7b62eef","Type":"ContainerStarted","Data":"c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb"} Jul 03 20:33:29.215549 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.215524 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" event={"ID":"0fc5c94e-c945-4d26-8f84-abd5711b8732","Type":"ContainerStarted","Data":"a171fd4ccca30629ce3bb3a2b9cba7e234325738d12130b1a94e7fe8f645de1e"} Jul 03 20:33:29.216914 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.216892 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5764894b74-9b5fp" event={"ID":"6c0915e3-471e-4f06-95fd-d75e42d526f5","Type":"ContainerStarted","Data":"99e1457f8108cbffc9371d8927f1382c3c9526d3650205599103f803fafbc55f"} Jul 03 20:33:29.216991 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.216931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5764894b74-9b5fp" event={"ID":"6c0915e3-471e-4f06-95fd-d75e42d526f5","Type":"ContainerStarted","Data":"43fd937ac868832121fa5973b6fd77b21799b69f94ffa5378a73c4ca8836d24d"} Jul 03 20:33:29.239795 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.239746 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j89p9" podStartSLOduration=2.198009686 podStartE2EDuration="11.23972883s" totalImagesPullingTime="9.041719144s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:33:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:29.239343588 +0000 UTC m=+66.148205042" watchObservedRunningTime="2026-07-03 20:33:29.23972883 +0000 UTC m=+66.148590268" Jul 03 20:33:29.266439 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.266390 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5764894b74-9b5fp" podStartSLOduration=2.2663720720000002 podStartE2EDuration="2.266372072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:29.266027813 +0000 UTC m=+66.174889256" watchObservedRunningTime="2026-07-03 20:33:29.266372072 +0000 UTC m=+66.175233513" Jul 03 20:33:29.291444 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.291370 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5979fcdf8b-bh5f5" podStartSLOduration=4.326545755 podStartE2EDuration="8.291345673s" totalImagesPullingTime="3.964799918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:29.289992826 +0000 UTC m=+66.198854270" watchObservedRunningTime="2026-07-03 20:33:29.291345673 +0000 UTC m=+66.200207118" Jul 03 20:33:29.458757 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.458707 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:29.461508 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.461484 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 03 20:33:29.471746 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.471671 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68bc84f9-c740-4bff-880b-52f29d27cf05-metrics-certs\") pod \"network-metrics-daemon-frps2\" (UID: \"68bc84f9-c740-4bff-880b-52f29d27cf05\") " pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:29.559308 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.559277 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:29.559777 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.559321 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:29.562092 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.562069 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 03 20:33:29.562218 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.562098 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 03 20:33:29.572740 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.572707 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 03 20:33:29.572863 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.572794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4b8c6c6b-9db0-4bb3-b254-a06244f079b8-original-pull-secret\") pod \"global-pull-secret-syncer-2lk2t\" (UID: \"4b8c6c6b-9db0-4bb3-b254-a06244f079b8\") " pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:29.583314 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.583285 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wb27\" (UniqueName: \"kubernetes.io/projected/6fb7e64f-5def-41bf-bbdd-89f063a661bb-kube-api-access-6wb27\") pod \"network-check-target-mrnzz\" (UID: \"6fb7e64f-5def-41bf-bbdd-89f063a661bb\") " pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:29.661027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.660997 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-k9k4n\"" Jul 03 20:33:29.669103 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.669074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:29.767502 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.767427 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9tq75\"" Jul 03 20:33:29.771519 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.771497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2lk2t" Jul 03 20:33:29.775600 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:29.775579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-frps2" Jul 03 20:33:30.043009 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.042876 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mrnzz"] Jul 03 20:33:30.052652 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:30.052625 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fb7e64f_5def_41bf_bbdd_89f063a661bb.slice/crio-11d6eefd7d23bb698a0689a6b7cf117b429995161557e58a0e14d80c3804bedc WatchSource:0}: Error finding container 11d6eefd7d23bb698a0689a6b7cf117b429995161557e58a0e14d80c3804bedc: Status 404 returned error can't find the container with id 11d6eefd7d23bb698a0689a6b7cf117b429995161557e58a0e14d80c3804bedc Jul 03 20:33:30.061040 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.060924 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-frps2"] Jul 03 20:33:30.063919 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:30.063892 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bc84f9_c740_4bff_880b_52f29d27cf05.slice/crio-a374a7c7cd6bbe0191d201900cbf9b6f94fd1e3ff61740eef2c99eafb04ac983 WatchSource:0}: Error finding container a374a7c7cd6bbe0191d201900cbf9b6f94fd1e3ff61740eef2c99eafb04ac983: Status 404 returned error can't find the container with id a374a7c7cd6bbe0191d201900cbf9b6f94fd1e3ff61740eef2c99eafb04ac983 Jul 03 20:33:30.078116 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.078092 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2lk2t"] Jul 03 20:33:30.080676 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:30.080648 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b8c6c6b_9db0_4bb3_b254_a06244f079b8.slice/crio-530dc943081ef89b0915ecd37ec6a685efee7ef12137298e5b1ce055b5b91f7d WatchSource:0}: Error finding container 530dc943081ef89b0915ecd37ec6a685efee7ef12137298e5b1ce055b5b91f7d: Status 404 returned error can't find the container with id 530dc943081ef89b0915ecd37ec6a685efee7ef12137298e5b1ce055b5b91f7d Jul 03 20:33:30.215837 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.215807 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:30.221873 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.221845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" event={"ID":"0fc5c94e-c945-4d26-8f84-abd5711b8732","Type":"ContainerStarted","Data":"b037b8a7d6601c74dbe7115ef35cf3fe56c439d93e80f96a1b651d42af338fba"} Jul 03 20:33:30.222012 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.221904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" event={"ID":"0fc5c94e-c945-4d26-8f84-abd5711b8732","Type":"ContainerStarted","Data":"cc6cd0317bb1b1b4efe39618490c5475cf552be990acf02cc256d22c1b2c4d0f"} Jul 03 20:33:30.222975 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.222954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2lk2t" event={"ID":"4b8c6c6b-9db0-4bb3-b254-a06244f079b8","Type":"ContainerStarted","Data":"530dc943081ef89b0915ecd37ec6a685efee7ef12137298e5b1ce055b5b91f7d"} Jul 03 20:33:30.223919 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.223897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mrnzz" event={"ID":"6fb7e64f-5def-41bf-bbdd-89f063a661bb","Type":"ContainerStarted","Data":"11d6eefd7d23bb698a0689a6b7cf117b429995161557e58a0e14d80c3804bedc"} Jul 03 20:33:30.224905 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.224877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frps2" event={"ID":"68bc84f9-c740-4bff-880b-52f29d27cf05","Type":"ContainerStarted","Data":"a374a7c7cd6bbe0191d201900cbf9b6f94fd1e3ff61740eef2c99eafb04ac983"} Jul 03 20:33:30.243841 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.243790 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gbf9b" podStartSLOduration=3.180416288 podStartE2EDuration="4.243770652s" totalImagesPullingTime="1.063354364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:30.242213423 +0000 UTC m=+67.151074863" watchObservedRunningTime="2026-07-03 20:33:30.243770652 +0000 UTC m=+67.152632095" Jul 03 20:33:30.393282 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.393176 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:30.494134 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.494092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:30.607502 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.607402 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:30.704603 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:30.704565 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:31.231861 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.231790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frps2" event={"ID":"68bc84f9-c740-4bff-880b-52f29d27cf05","Type":"ContainerStarted","Data":"438bc2e733a96aa96461c000724523fcd3f9d762288712df16ce06331e20f1e6"} Jul 03 20:33:31.588609 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.588562 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:31.683124 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.683093 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:31.820958 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.820924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:31.849938 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.849799 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw"] Jul 03 20:33:31.853279 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.853254 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:31.856007 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.855980 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 03 20:33:31.856152 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.855991 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zbjh6\"" Jul 03 20:33:31.856152 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.855991 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 03 20:33:31.863119 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.863098 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq"] Jul 03 20:33:31.866485 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.866455 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw"] Jul 03 20:33:31.866635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.866566 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:31.870373 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.870136 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nzfnk\"" Jul 03 20:33:31.870373 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.870137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 03 20:33:31.870551 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.870437 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 03 20:33:31.870838 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.870769 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 03 20:33:31.879516 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.879496 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq"] Jul 03 20:33:31.891274 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.891203 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rttff"] Jul 03 20:33:31.894917 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.894892 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.897766 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.897743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 03 20:33:31.898224 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.897753 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 03 20:33:31.898224 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.897791 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 03 20:33:31.898224 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.897897 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dgnqf\"" Jul 03 20:33:31.928527 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.928476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:31.987443 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-wtmp\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.987624 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcef19da-72ff-4ffc-93d3-f25c2ad80274-metrics-client-ca\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.987624 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987489 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/499d996a-7267-4ae7-b5f0-2497805f9921-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:31.987624 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987521 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-sys\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.987624 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987548 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx9cw\" (UniqueName: \"kubernetes.io/projected/dcef19da-72ff-4ffc-93d3-f25c2ad80274-kube-api-access-bx9cw\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.987839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987635 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgst4\" (UniqueName: \"kubernetes.io/projected/499d996a-7267-4ae7-b5f0-2497805f9921-kube-api-access-vgst4\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:31.987839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.987839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987746 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-accelerators-collector-config\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.987839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b42dec76-8fa7-4e85-9494-c3d77408cd7f-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:31.987839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987822 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499d996a-7267-4ae7-b5f0-2497805f9921-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987886 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b42dec76-8fa7-4e85-9494-c3d77408cd7f-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987911 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-tls\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987966 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.987996 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9p6v\" (UniqueName: \"kubernetes.io/projected/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-api-access-d9p6v\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.988018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-root\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.988079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.988041 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-textfile\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:31.988398 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:31.988078 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499d996a-7267-4ae7-b5f0-2497805f9921-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.025134 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.025097 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089375 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089461 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9p6v\" (UniqueName: \"kubernetes.io/projected/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-api-access-d9p6v\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-root\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089509 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-textfile\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089533 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499d996a-7267-4ae7-b5f0-2497805f9921-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-wtmp\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcef19da-72ff-4ffc-93d3-f25c2ad80274-metrics-client-ca\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089647 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/499d996a-7267-4ae7-b5f0-2497805f9921-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089677 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-sys\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089718 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-root\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-textfile\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.089726 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx9cw\" (UniqueName: \"kubernetes.io/projected/dcef19da-72ff-4ffc-93d3-f25c2ad80274-kube-api-access-bx9cw\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090030 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgst4\" (UniqueName: \"kubernetes.io/projected/499d996a-7267-4ae7-b5f0-2497805f9921-kube-api-access-vgst4\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.090884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-accelerators-collector-config\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b42dec76-8fa7-4e85-9494-c3d77408cd7f-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090145 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-wtmp\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499d996a-7267-4ae7-b5f0-2497805f9921-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090191 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090222 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b42dec76-8fa7-4e85-9494-c3d77408cd7f-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-tls\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:32.090350 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090399 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcef19da-72ff-4ffc-93d3-f25c2ad80274-metrics-client-ca\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090416 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/499d996a-7267-4ae7-b5f0-2497805f9921-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090034 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcef19da-72ff-4ffc-93d3-f25c2ad80274-sys\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:32.090408 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-tls podName:dcef19da-72ff-4ffc-93d3-f25c2ad80274 nodeName:}" failed. No retries permitted until 2026-07-03 20:33:32.59038894 +0000 UTC m=+69.499250373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-tls") pod "node-exporter-rttff" (UID: "dcef19da-72ff-4ffc-93d3-f25c2ad80274") : secret "node-exporter-tls" not found Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.090815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b42dec76-8fa7-4e85-9494-c3d77408cd7f-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.091123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b42dec76-8fa7-4e85-9494-c3d77408cd7f-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.092039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.091137 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-accelerators-collector-config\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.093326 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.093294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/499d996a-7267-4ae7-b5f0-2497805f9921-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.093566 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.093541 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.093707 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.093634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/499d996a-7267-4ae7-b5f0-2497805f9921-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.094192 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.094110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.094192 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.094126 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.101713 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.101616 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgst4\" (UniqueName: \"kubernetes.io/projected/499d996a-7267-4ae7-b5f0-2497805f9921-kube-api-access-vgst4\") pod \"openshift-state-metrics-54cf96dfcf-86pdw\" (UID: \"499d996a-7267-4ae7-b5f0-2497805f9921\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.101857 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.101820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9p6v\" (UniqueName: \"kubernetes.io/projected/b42dec76-8fa7-4e85-9494-c3d77408cd7f-kube-api-access-d9p6v\") pod \"kube-state-metrics-7c9dbb8b7d-mxmkq\" (UID: \"b42dec76-8fa7-4e85-9494-c3d77408cd7f\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.101916 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.101867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx9cw\" (UniqueName: \"kubernetes.io/projected/dcef19da-72ff-4ffc-93d3-f25c2ad80274-kube-api-access-bx9cw\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.110925 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.110726 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:32.110925 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.110783 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:32.117400 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.117374 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:32.126922 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.126878 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.166929 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.166897 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" Jul 03 20:33:32.180188 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.180161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" Jul 03 20:33:32.227975 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.227936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.237929 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.237844 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-frps2" event={"ID":"68bc84f9-c740-4bff-880b-52f29d27cf05","Type":"ContainerStarted","Data":"44d325a1956e0d17f01934697bd7d23ba45821f60106bd2d7e20c8973c9dea09"} Jul 03 20:33:32.243091 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.243061 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:33:32.259816 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.259761 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-frps2" podStartSLOduration=66.267922517 podStartE2EDuration="1m7.259739665s" totalImagesPullingTime="991.817148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:32.257119892 +0000 UTC m=+69.165981325" watchObservedRunningTime="2026-07-03 20:33:32.259739665 +0000 UTC m=+69.168601111" Jul 03 20:33:32.332506 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.332472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.446704 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.446654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.546247 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.546166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.595003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.594966 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-tls\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.597957 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.597925 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dcef19da-72ff-4ffc-93d3-f25c2ad80274-node-exporter-tls\") pod \"node-exporter-rttff\" (UID: \"dcef19da-72ff-4ffc-93d3-f25c2ad80274\") " pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.806964 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.806872 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rttff" Jul 03 20:33:32.858368 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.858330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.946200 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.946165 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:32.951847 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.951822 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 20:33:32.959759 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.959734 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:32.962598 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.962572 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 03 20:33:32.962858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.962761 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 03 20:33:32.964442 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.964300 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 03 20:33:32.964442 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.964368 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 03 20:33:32.965232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.964743 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 03 20:33:32.965232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.964675 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 03 20:33:32.965232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.964829 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 03 20:33:32.965232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.965038 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 03 20:33:32.965232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.965103 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-crzvh\"" Jul 03 20:33:32.965232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.964747 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 03 20:33:32.974701 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:32.974660 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 20:33:33.061338 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.061258 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:33.099649 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099618 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e600b31-4558-4f0c-871f-307e811b71ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.099885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099659 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.099885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e600b31-4558-4f0c-871f-307e811b71ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.099885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099769 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd7vj\" (UniqueName: \"kubernetes.io/projected/3e600b31-4558-4f0c-871f-307e811b71ac-kube-api-access-hd7vj\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.099885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.099885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.099885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-web-config\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.099885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099880 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.100137 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099899 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e600b31-4558-4f0c-871f-307e811b71ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.100137 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e600b31-4558-4f0c-871f-307e811b71ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.100137 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099944 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.100137 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e600b31-4558-4f0c-871f-307e811b71ac-config-out\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.100137 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.099985 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201293 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd7vj\" (UniqueName: \"kubernetes.io/projected/3e600b31-4558-4f0c-871f-307e811b71ac-kube-api-access-hd7vj\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201293 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201478 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-web-config\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201522 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e600b31-4558-4f0c-871f-307e811b71ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201803 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201738 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e600b31-4558-4f0c-871f-307e811b71ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201803 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201809 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e600b31-4558-4f0c-871f-307e811b71ac-config-out\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.201911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201839 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.202018 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e600b31-4558-4f0c-871f-307e811b71ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.202018 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.202018 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.201987 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e600b31-4558-4f0c-871f-307e811b71ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.202175 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.202105 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3e600b31-4558-4f0c-871f-307e811b71ac-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.202737 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.202312 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e600b31-4558-4f0c-871f-307e811b71ac-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.203561 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.203534 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e600b31-4558-4f0c-871f-307e811b71ac-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.204933 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.204910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.205339 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.205297 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.205913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.205440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.205913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.205943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e600b31-4558-4f0c-871f-307e811b71ac-config-out\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.205913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.206102 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-web-config\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.206324 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.206187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-config-volume\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.206642 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.206621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.207411 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.207393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e600b31-4558-4f0c-871f-307e811b71ac-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.207526 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.207457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e600b31-4558-4f0c-871f-307e811b71ac-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.210114 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.210096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd7vj\" (UniqueName: \"kubernetes.io/projected/3e600b31-4558-4f0c-871f-307e811b71ac-kube-api-access-hd7vj\") pod \"alertmanager-main-0\" (UID: \"3e600b31-4558-4f0c-871f-307e811b71ac\") " pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:33.273782 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:33.273748 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 03 20:33:34.350113 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.350068 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:34.451280 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.451243 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:34.788130 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.788091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:34.832382 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:34.832351 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcef19da_72ff_4ffc_93d3_f25c2ad80274.slice/crio-32a5724e53fd8da1bb9a9611dbb56573719ed2c334206204251f92812c025816 WatchSource:0}: Error finding container 32a5724e53fd8da1bb9a9611dbb56573719ed2c334206204251f92812c025816: Status 404 returned error can't find the container with id 32a5724e53fd8da1bb9a9611dbb56573719ed2c334206204251f92812c025816 Jul 03 20:33:34.853471 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.853306 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-554fdcb6c4-cx672"] Jul 03 20:33:34.856112 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.856090 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.858967 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.858945 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 03 20:33:34.859708 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.859081 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6f30ivmgufp68\"" Jul 03 20:33:34.859708 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.859319 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vcs92\"" Jul 03 20:33:34.859708 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.859446 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 03 20:33:34.859708 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.859552 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 03 20:33:34.859952 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.859788 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 03 20:33:34.860030 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.860011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 03 20:33:34.869029 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.868929 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-554fdcb6c4-cx672"] Jul 03 20:33:34.873502 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.873035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921090 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-grpc-tls\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-tls\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca00bb0-1577-4292-bbcc-4997010f07e5-metrics-client-ca\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:34.921635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:34.921370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prr66\" (UniqueName: \"kubernetes.io/projected/3ca00bb0-1577-4292-bbcc-4997010f07e5-kube-api-access-prr66\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.022160 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.022286 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-grpc-tls\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.022286 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-tls\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.022286 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca00bb0-1577-4292-bbcc-4997010f07e5-metrics-client-ca\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.022450 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.023248 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022549 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prr66\" (UniqueName: \"kubernetes.io/projected/3ca00bb0-1577-4292-bbcc-4997010f07e5-kube-api-access-prr66\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.023248 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.023248 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.022676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.023929 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.023903 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3ca00bb0-1577-4292-bbcc-4997010f07e5-metrics-client-ca\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.025541 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.025507 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-tls\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.026127 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.026104 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-grpc-tls\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.026215 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.026207 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.026628 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.026590 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.026628 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.026612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.026792 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.026772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3ca00bb0-1577-4292-bbcc-4997010f07e5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.031325 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.031304 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prr66\" (UniqueName: \"kubernetes.io/projected/3ca00bb0-1577-4292-bbcc-4997010f07e5-kube-api-access-prr66\") pod \"thanos-querier-554fdcb6c4-cx672\" (UID: \"3ca00bb0-1577-4292-bbcc-4997010f07e5\") " pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.042435 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.042368 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 03 20:33:35.044606 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:35.044578 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e600b31_4558_4f0c_871f_307e811b71ac.slice/crio-06036c2c6a67f5aff17311cc0a5018983be528627288792cea1e8ffb01d68b23 WatchSource:0}: Error finding container 06036c2c6a67f5aff17311cc0a5018983be528627288792cea1e8ffb01d68b23: Status 404 returned error can't find the container with id 06036c2c6a67f5aff17311cc0a5018983be528627288792cea1e8ffb01d68b23 Jul 03 20:33:35.106411 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.106377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:35.202306 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.202276 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:35.203057 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.203037 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d48rr" Jul 03 20:33:35.252110 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.251670 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw"] Jul 03 20:33:35.253147 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.253060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerStarted","Data":"06036c2c6a67f5aff17311cc0a5018983be528627288792cea1e8ffb01d68b23"} Jul 03 20:33:35.253534 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.253471 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq"] Jul 03 20:33:35.258361 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.255152 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rttff" event={"ID":"dcef19da-72ff-4ffc-93d3-f25c2ad80274","Type":"ContainerStarted","Data":"32a5724e53fd8da1bb9a9611dbb56573719ed2c334206204251f92812c025816"} Jul 03 20:33:35.260151 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:35.259981 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42dec76_8fa7_4e85_9494_c3d77408cd7f.slice/crio-1116773f82405f12560d742983df70fcda9ae6f2446d31720a2cb16577f87016 WatchSource:0}: Error finding container 1116773f82405f12560d742983df70fcda9ae6f2446d31720a2cb16577f87016: Status 404 returned error can't find the container with id 1116773f82405f12560d742983df70fcda9ae6f2446d31720a2cb16577f87016 Jul 03 20:33:35.263767 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.263732 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2lk2t" event={"ID":"4b8c6c6b-9db0-4bb3-b254-a06244f079b8","Type":"ContainerStarted","Data":"b5ae211c45d6cdda4796414e9fa4973838756d810fe982059fbd54a486b053e8"} Jul 03 20:33:35.268586 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.268550 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mrnzz" event={"ID":"6fb7e64f-5def-41bf-bbdd-89f063a661bb","Type":"ContainerStarted","Data":"e62c099033ffa10d1d13321972aa3484f92d3c9d2d0d680610002696129126c0"} Jul 03 20:33:35.271336 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.270543 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:33:35.284371 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.284319 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2lk2t" podStartSLOduration=65.52310726 podStartE2EDuration="1m10.284299627s" totalImagesPullingTime="4.761192367s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:35.283714227 +0000 UTC m=+72.192575666" watchObservedRunningTime="2026-07-03 20:33:35.284299627 +0000 UTC m=+72.193161072" Jul 03 20:33:35.357962 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.357916 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mrnzz" podStartSLOduration=65.579792419 podStartE2EDuration="1m10.357899748s" totalImagesPullingTime="4.778107329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:35.302006919 +0000 UTC m=+72.210868362" watchObservedRunningTime="2026-07-03 20:33:35.357899748 +0000 UTC m=+72.266761190" Jul 03 20:33:35.359574 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.359552 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-554fdcb6c4-cx672"] Jul 03 20:33:35.364256 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:33:35.364190 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca00bb0_1577_4292_bbcc_4997010f07e5.slice/crio-7352e21235db1a3c15d8792e81442b8a2d2694f51255cc6331c58f8522e836bd WatchSource:0}: Error finding container 7352e21235db1a3c15d8792e81442b8a2d2694f51255cc6331c58f8522e836bd: Status 404 returned error can't find the container with id 7352e21235db1a3c15d8792e81442b8a2d2694f51255cc6331c58f8522e836bd Jul 03 20:33:35.531146 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:35.531115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:36.239393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.239360 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:36.264092 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.264060 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76bd84d-7kljq"] Jul 03 20:33:36.266666 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.266644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.269653 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.269612 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 03 20:33:36.270128 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.270109 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 03 20:33:36.271396 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.271175 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5wdrw\"" Jul 03 20:33:36.271396 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.271248 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 03 20:33:36.271549 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.271469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 03 20:33:36.271721 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.271704 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5ddes71iie47a\"" Jul 03 20:33:36.276720 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.276696 2578 generic.go:356] "Generic (PLEG): container finished" podID="3e600b31-4558-4f0c-871f-307e811b71ac" containerID="c49e46f5e0041e443ee481f00e64b5b2661f46ad788d562369e1d8f7f691f861" exitCode=0 Jul 03 20:33:36.276829 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.276779 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerDied","Data":"c49e46f5e0041e443ee481f00e64b5b2661f46ad788d562369e1d8f7f691f861"} Jul 03 20:33:36.278817 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.278790 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" event={"ID":"b42dec76-8fa7-4e85-9494-c3d77408cd7f","Type":"ContainerStarted","Data":"1116773f82405f12560d742983df70fcda9ae6f2446d31720a2cb16577f87016"} Jul 03 20:33:36.286224 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.286200 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76bd84d-7kljq"] Jul 03 20:33:36.287457 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.287428 2578 generic.go:356] "Generic (PLEG): container finished" podID="dcef19da-72ff-4ffc-93d3-f25c2ad80274" containerID="7d7a9c054b4a14f5c4d95a35fe6889dcf01e729a0208f89e6fb1c5bb9cf47ac2" exitCode=0 Jul 03 20:33:36.287543 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.287512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rttff" event={"ID":"dcef19da-72ff-4ffc-93d3-f25c2ad80274","Type":"ContainerDied","Data":"7d7a9c054b4a14f5c4d95a35fe6889dcf01e729a0208f89e6fb1c5bb9cf47ac2"} Jul 03 20:33:36.292319 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.292300 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" event={"ID":"3ca00bb0-1577-4292-bbcc-4997010f07e5","Type":"ContainerStarted","Data":"7352e21235db1a3c15d8792e81442b8a2d2694f51255cc6331c58f8522e836bd"} Jul 03 20:33:36.299338 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.299313 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" event={"ID":"499d996a-7267-4ae7-b5f0-2497805f9921","Type":"ContainerStarted","Data":"a4bad206ad22a4102268d3e478c68e1bf9076bf2b96193718e5ab7dd67ca7247"} Jul 03 20:33:36.299441 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.299373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" event={"ID":"499d996a-7267-4ae7-b5f0-2497805f9921","Type":"ContainerStarted","Data":"a1f4bc452100c5e75e199ed2dbbbc17c5512f1b24415389a50a63aedfb887206"} Jul 03 20:33:36.299441 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.299403 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" event={"ID":"499d996a-7267-4ae7-b5f0-2497805f9921","Type":"ContainerStarted","Data":"d1b8f7edc8d5817e7dd66b888113df621720b6afc7c39e6c630b66c494fee24e"} Jul 03 20:33:36.323623 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.323592 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:36.336087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.335754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-metrics-server-audit-profiles\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.336087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.335807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-secret-metrics-server-tls\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.336087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.335848 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-audit-log\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.336087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.335887 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-secret-metrics-server-client-certs\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.336087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.335916 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-client-ca-bundle\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.336087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.335948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.336087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.335972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpkzt\" (UniqueName: \"kubernetes.io/projected/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-kube-api-access-qpkzt\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.437128 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-metrics-server-audit-profiles\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.437246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-secret-metrics-server-tls\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.437330 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-audit-log\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.437426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-secret-metrics-server-client-certs\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.437471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-client-ca-bundle\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.437559 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.437587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpkzt\" (UniqueName: \"kubernetes.io/projected/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-kube-api-access-qpkzt\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.438858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.438230 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-audit-log\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.440710 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.439720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-metrics-server-audit-profiles\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.440710 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.440238 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.442669 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.442642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-secret-metrics-server-client-certs\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.444006 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.443966 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-client-ca-bundle\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.444665 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.444621 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-secret-metrics-server-tls\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.451884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.451829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpkzt\" (UniqueName: \"kubernetes.io/projected/867103fb-39b9-4422-b4bb-4d8ccaed3bbb-kube-api-access-qpkzt\") pod \"metrics-server-76bd84d-7kljq\" (UID: \"867103fb-39b9-4422-b4bb-4d8ccaed3bbb\") " pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.593108 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.593022 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:36.770824 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.770776 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:36.826800 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.826765 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c"] Jul 03 20:33:36.829605 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.829579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:36.836436 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.836415 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5764894b74-9b5fp"] Jul 03 20:33:36.838911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.838888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 03 20:33:36.839313 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.839135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-k4btk\"" Jul 03 20:33:36.860222 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.860158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c"] Jul 03 20:33:36.893346 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.893314 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8657d5d55-p7q65"] Jul 03 20:33:36.895779 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.895755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:36.915034 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.915006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:36.924158 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.924100 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8657d5d55-p7q65"] Jul 03 20:33:36.941864 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.941826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lft6c\" (UID: \"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:36.941864 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:36.941897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgxkx\" (UniqueName: \"kubernetes.io/projected/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-kube-api-access-dgxkx\") pod \"monitoring-plugin-d5dcff7cf-lft6c\" (UID: \"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:37.042548 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77hdf\" (UniqueName: \"kubernetes.io/projected/c23f289b-12e1-4412-a680-2200eb2ccb12-kube-api-access-77hdf\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.042548 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-trusted-ca-bundle\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.042839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042635 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lft6c\" (UID: \"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:37.042839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042679 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-console-config\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.042839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042730 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-oauth-serving-cert\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.042839 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:37.042751 2578 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 03 20:33:37.042839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042764 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-serving-cert\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.042839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042795 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgxkx\" (UniqueName: \"kubernetes.io/projected/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-kube-api-access-dgxkx\") pod \"monitoring-plugin-d5dcff7cf-lft6c\" (UID: \"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:37.042839 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:33:37.042815 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-monitoring-plugin-cert podName:46064ee0-1c1e-4b39-bd20-a3a5a3cd1080 nodeName:}" failed. No retries permitted until 2026-07-03 20:33:37.542791049 +0000 UTC m=+74.451652482 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-lft6c" (UID: "46064ee0-1c1e-4b39-bd20-a3a5a3cd1080") : secret "monitoring-plugin-cert" not found Jul 03 20:33:37.043168 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042851 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-service-ca\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.043168 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.042885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-oauth-config\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.052173 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.052150 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgxkx\" (UniqueName: \"kubernetes.io/projected/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-kube-api-access-dgxkx\") pod \"monitoring-plugin-d5dcff7cf-lft6c\" (UID: \"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:37.144375 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.144290 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-console-config\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.144375 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.144332 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-oauth-serving-cert\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.144375 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.144364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-serving-cert\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.144630 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.144396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-service-ca\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.144630 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.144418 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-oauth-config\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.144630 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.144491 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77hdf\" (UniqueName: \"kubernetes.io/projected/c23f289b-12e1-4412-a680-2200eb2ccb12-kube-api-access-77hdf\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.144630 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.144515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-trusted-ca-bundle\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.145195 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.145154 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-console-config\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.145480 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.145451 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-oauth-serving-cert\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.145761 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.145657 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-service-ca\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.146155 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.146130 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-trusted-ca-bundle\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.147528 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.147475 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-serving-cert\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.147637 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.147528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-oauth-config\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.153258 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.153234 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77hdf\" (UniqueName: \"kubernetes.io/projected/c23f289b-12e1-4412-a680-2200eb2ccb12-kube-api-access-77hdf\") pod \"console-8657d5d55-p7q65\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.208027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.207981 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:37.305910 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.305871 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rttff" event={"ID":"dcef19da-72ff-4ffc-93d3-f25c2ad80274","Type":"ContainerStarted","Data":"737a6972c2ad9fc97ed2c423a1e2520b4cc1239b66eb6fb8d99e047deb71e1f3"} Jul 03 20:33:37.306086 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.305938 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rttff" event={"ID":"dcef19da-72ff-4ffc-93d3-f25c2ad80274","Type":"ContainerStarted","Data":"97eb1a0a7a1864ea2994431244624481b0bf6f100329088561b05586a0b603f0"} Jul 03 20:33:37.327588 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.327529 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rttff" podStartSLOduration=5.022606559 podStartE2EDuration="6.327511887s" totalImagesPullingTime="1.213259203s" totalInitContainerRuntime="91.646125ms" isStatefulPod=true podCreationTimestamp="2026-07-03 20:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:37.325481015 +0000 UTC m=+74.234342457" watchObservedRunningTime="2026-07-03 20:33:37.327511887 +0000 UTC m=+74.236373328" Jul 03 20:33:37.548256 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.548225 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lft6c\" (UID: \"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:37.549207 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.549176 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:37.551021 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.550991 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/46064ee0-1c1e-4b39-bd20-a3a5a3cd1080-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-lft6c\" (UID: \"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:37.653858 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.653826 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:37.750309 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.750280 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:37.894893 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:37.894800 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:33:38.044766 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.044712 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:38.227046 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.227022 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8657d5d55-p7q65"] Jul 03 20:33:38.263896 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.263148 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76bd84d-7kljq"] Jul 03 20:33:38.319630 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.317636 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c"] Jul 03 20:33:38.326354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.326113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerStarted","Data":"4136a030f4c5e84abc4b7b34ae707cd820c1528ee60e08aa0ce2cc90f475ba55"} Jul 03 20:33:38.335563 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.333894 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" event={"ID":"b42dec76-8fa7-4e85-9494-c3d77408cd7f","Type":"ContainerStarted","Data":"8faf372e212c0574e34cfdfe91b73be5724658fbceb884bd982d71a95aa1d2dd"} Jul 03 20:33:38.336975 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.336920 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8657d5d55-p7q65" event={"ID":"c23f289b-12e1-4412-a680-2200eb2ccb12","Type":"ContainerStarted","Data":"5cbd3b14c74dee9aae63c1d9b2d8bf334a52c968d3ac762b7ee029415af71796"} Jul 03 20:33:38.339806 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.339725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" event={"ID":"867103fb-39b9-4422-b4bb-4d8ccaed3bbb","Type":"ContainerStarted","Data":"5459149dbc33611a1046f3895d457271c9426c636e84fb9b2a847d8bc2d00feb"} Jul 03 20:33:38.348402 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.348374 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" event={"ID":"3ca00bb0-1577-4292-bbcc-4997010f07e5","Type":"ContainerStarted","Data":"c5e5aee4ea7be19b7bfeb1031abb2643c67af7dc27b04002e243b31313130fe3"} Jul 03 20:33:38.354879 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.354814 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" event={"ID":"499d996a-7267-4ae7-b5f0-2497805f9921","Type":"ContainerStarted","Data":"e0d145248f8e962739fe4df2683fa07338f09828511782ff340d7480440ea4a5"} Jul 03 20:33:38.399043 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.397703 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-86pdw" podStartSLOduration=4.774933869 podStartE2EDuration="7.39766728s" totalImagesPullingTime="2.622733411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:38.397351998 +0000 UTC m=+75.306213441" watchObservedRunningTime="2026-07-03 20:33:38.39766728 +0000 UTC m=+75.306528715" Jul 03 20:33:38.545026 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.544997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:38.645213 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:38.645099 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:39.361027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.360992 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" event={"ID":"3ca00bb0-1577-4292-bbcc-4997010f07e5","Type":"ContainerStarted","Data":"4015a72158789adfcb18ec24328d97a30eede82966c3c2289fc63ac14adf26d5"} Jul 03 20:33:39.361180 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.361081 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" event={"ID":"3ca00bb0-1577-4292-bbcc-4997010f07e5","Type":"ContainerStarted","Data":"06fa281a56e785bd4632de5d9b430b66de881b39963c4bdc675c8adc0792de5f"} Jul 03 20:33:39.363326 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.363296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" event={"ID":"b42dec76-8fa7-4e85-9494-c3d77408cd7f","Type":"ContainerStarted","Data":"6ec2ddf63da0ec125998a8c1d3e761edf21072c44e2a26a2cc740f926ac5bc0a"} Jul 03 20:33:39.363471 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.363353 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" event={"ID":"b42dec76-8fa7-4e85-9494-c3d77408cd7f","Type":"ContainerStarted","Data":"9f72d2c952f9197a7da1e5f04fe5a0a4950c71f254ed4596b2452e343b27ccc2"} Jul 03 20:33:39.364543 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.364512 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" event={"ID":"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080","Type":"ContainerStarted","Data":"5e7746a4405eecfa743ce4cbaf5dd91f95e337a902a3b71e3d840aa2de748695"} Jul 03 20:33:39.367996 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.367968 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerStarted","Data":"3d7af44404d4787eb96e906e31863b1dabc8d80b03139ff8900844565ba29b07"} Jul 03 20:33:39.368168 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.368028 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerStarted","Data":"57ed0047ca58b205db4dcca9cf05fcb733e936ed32b3fb893c7e816f48aac00b"} Jul 03 20:33:39.368168 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.368065 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerStarted","Data":"2b175147dd7896c36914f8598dda32afb58789f33053e2545ef3390ee6945c44"} Jul 03 20:33:39.368168 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.368104 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerStarted","Data":"82c615f2db1bb83e9a82d66b5b3a852638e8e632736f47c1d3c092ffe1ceb260"} Jul 03 20:33:39.369628 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.369602 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8657d5d55-p7q65" event={"ID":"c23f289b-12e1-4412-a680-2200eb2ccb12","Type":"ContainerStarted","Data":"f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348"} Jul 03 20:33:39.385524 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.385481 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mxmkq" podStartSLOduration=5.631273289 podStartE2EDuration="8.385463862s" totalImagesPullingTime="2.754190573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:39.383987592 +0000 UTC m=+76.292849035" watchObservedRunningTime="2026-07-03 20:33:39.385463862 +0000 UTC m=+76.294325304" Jul 03 20:33:39.410004 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.409950 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8657d5d55-p7q65" podStartSLOduration=3.40992868 podStartE2EDuration="3.40992868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:39.408761472 +0000 UTC m=+76.317622916" watchObservedRunningTime="2026-07-03 20:33:39.40992868 +0000 UTC m=+76.318790113" Jul 03 20:33:39.642716 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.642587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:39.738732 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.738677 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:39.795938 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:39.795895 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:40.388180 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.388086 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" event={"ID":"46064ee0-1c1e-4b39-bd20-a3a5a3cd1080","Type":"ContainerStarted","Data":"51ce3b28ab6e370849bb019b9fea05b2a28bcb8dbf0b1f97a160ad28cab9eb2b"} Jul 03 20:33:40.388180 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.388178 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:40.390403 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.390371 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" event={"ID":"867103fb-39b9-4422-b4bb-4d8ccaed3bbb","Type":"ContainerStarted","Data":"29f0baf5b1eb977cd9d245c021834febbdeb0ff5de382288d6269ea7b4040bb2"} Jul 03 20:33:40.393522 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.393502 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" Jul 03 20:33:40.398527 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.398503 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3e600b31-4558-4f0c-871f-307e811b71ac","Type":"ContainerStarted","Data":"6492c5caf18ce4bd125dff2f7d0ec830caf0c6bc1b42ac008f88b575f09e0f72"} Jul 03 20:33:40.404320 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.404292 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" event={"ID":"3ca00bb0-1577-4292-bbcc-4997010f07e5","Type":"ContainerStarted","Data":"6dd40d697e3622537917b3ab3a8be4d6bfc6015d5c6c258c67b5b0813ac0f287"} Jul 03 20:33:40.404431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.404367 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" event={"ID":"3ca00bb0-1577-4292-bbcc-4997010f07e5","Type":"ContainerStarted","Data":"18493ec16f459232810b8a0e96843b180126e2d3fd1627755eac74de02a8e615"} Jul 03 20:33:40.404431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.404408 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" event={"ID":"3ca00bb0-1577-4292-bbcc-4997010f07e5","Type":"ContainerStarted","Data":"0309eefb6a1d789321875571939aa17b3c2314d93362960ef2cb4a760234b70b"} Jul 03 20:33:40.406140 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.406094 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-lft6c" podStartSLOduration=2.639146978 podStartE2EDuration="4.406077176s" totalImagesPullingTime="1.766930198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:40.405293479 +0000 UTC m=+77.314154921" watchObservedRunningTime="2026-07-03 20:33:40.406077176 +0000 UTC m=+77.314938620" Jul 03 20:33:40.433604 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.433552 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" podStartSLOduration=2.152338299 podStartE2EDuration="6.433533546s" totalImagesPullingTime="4.281195247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:40.431680239 +0000 UTC m=+77.340541683" watchObservedRunningTime="2026-07-03 20:33:40.433533546 +0000 UTC m=+77.342394992" Jul 03 20:33:40.466887 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.466823 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" podStartSLOduration=2.658233422 podStartE2EDuration="4.466802793s" totalImagesPullingTime="1.808569371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:40.464903718 +0000 UTC m=+77.373765161" watchObservedRunningTime="2026-07-03 20:33:40.466802793 +0000 UTC m=+77.375664236" Jul 03 20:33:40.493000 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.492965 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:40.493447 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.493411 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.230333198 podStartE2EDuration="8.493397313s" totalImagesPullingTime="4.241293385s" totalInitContainerRuntime="21.77073ms" isStatefulPod=false podCreationTimestamp="2026-07-03 20:33:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:33:40.491532482 +0000 UTC m=+77.400393927" watchObservedRunningTime="2026-07-03 20:33:40.493397313 +0000 UTC m=+77.402258733" Jul 03 20:33:40.596927 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.596841 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:40.655889 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:40.655841 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:41.409866 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:41.409836 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:42.498652 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:42.498620 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:42.547673 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:42.547642 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:45.385299 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:45.385194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:45.483873 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:45.483836 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:47.208861 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.208827 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:47.209327 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.208896 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:47.213655 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.213634 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:47.423864 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.423836 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-554fdcb6c4-cx672" Jul 03 20:33:47.438699 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.438671 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:33:47.516062 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.515986 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5979fcdf8b-bh5f5"] Jul 03 20:33:47.661515 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.661479 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:47.759089 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.759055 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:47.862028 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.861938 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:47.961725 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:47.961695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:48.183888 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:48.183861 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:48.292152 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:48.292118 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:51.511287 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:51.511253 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:33:56.593869 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:56.593837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:33:56.594251 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:33:56.593921 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:34:00.394774 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:00.394739 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:00.457231 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:00.457201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:01.866282 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:01.866239 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5764894b74-9b5fp" podUID="6c0915e3-471e-4f06-95fd-d75e42d526f5" containerName="console" containerID="cri-o://99e1457f8108cbffc9371d8927f1382c3c9526d3650205599103f803fafbc55f" gracePeriod=15 Jul 03 20:34:02.500541 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.500506 2578 generic.go:356] "Generic (PLEG): container finished" podID="6c0915e3-471e-4f06-95fd-d75e42d526f5" containerID="99e1457f8108cbffc9371d8927f1382c3c9526d3650205599103f803fafbc55f" exitCode=0 Jul 03 20:34:02.500722 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.500561 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5764894b74-9b5fp" event={"ID":"6c0915e3-471e-4f06-95fd-d75e42d526f5","Type":"ContainerDied","Data":"99e1457f8108cbffc9371d8927f1382c3c9526d3650205599103f803fafbc55f"} Jul 03 20:34:02.630506 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.630476 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:34:02.689871 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.689831 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-oauth-config\") pod \"6c0915e3-471e-4f06-95fd-d75e42d526f5\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " Jul 03 20:34:02.689871 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.689873 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-serving-cert\") pod \"6c0915e3-471e-4f06-95fd-d75e42d526f5\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " Jul 03 20:34:02.690121 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.689925 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-service-ca\") pod \"6c0915e3-471e-4f06-95fd-d75e42d526f5\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " Jul 03 20:34:02.690121 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.689979 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btdv9\" (UniqueName: \"kubernetes.io/projected/6c0915e3-471e-4f06-95fd-d75e42d526f5-kube-api-access-btdv9\") pod \"6c0915e3-471e-4f06-95fd-d75e42d526f5\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " Jul 03 20:34:02.690121 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.689998 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-config\") pod \"6c0915e3-471e-4f06-95fd-d75e42d526f5\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " Jul 03 20:34:02.690121 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.690020 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-trusted-ca-bundle\") pod \"6c0915e3-471e-4f06-95fd-d75e42d526f5\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " Jul 03 20:34:02.690121 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.690038 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-oauth-serving-cert\") pod \"6c0915e3-471e-4f06-95fd-d75e42d526f5\" (UID: \"6c0915e3-471e-4f06-95fd-d75e42d526f5\") " Jul 03 20:34:02.690560 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.690532 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "6c0915e3-471e-4f06-95fd-d75e42d526f5" (UID: "6c0915e3-471e-4f06-95fd-d75e42d526f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:34:02.690652 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.690561 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-config" (OuterVolumeSpecName: "console-config") pod "6c0915e3-471e-4f06-95fd-d75e42d526f5" (UID: "6c0915e3-471e-4f06-95fd-d75e42d526f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:34:02.690652 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.690565 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6c0915e3-471e-4f06-95fd-d75e42d526f5" (UID: "6c0915e3-471e-4f06-95fd-d75e42d526f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:34:02.690794 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.690665 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6c0915e3-471e-4f06-95fd-d75e42d526f5" (UID: "6c0915e3-471e-4f06-95fd-d75e42d526f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:34:02.692532 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.692504 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6c0915e3-471e-4f06-95fd-d75e42d526f5" (UID: "6c0915e3-471e-4f06-95fd-d75e42d526f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:34:02.692625 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.692530 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0915e3-471e-4f06-95fd-d75e42d526f5-kube-api-access-btdv9" (OuterVolumeSpecName: "kube-api-access-btdv9") pod "6c0915e3-471e-4f06-95fd-d75e42d526f5" (UID: "6c0915e3-471e-4f06-95fd-d75e42d526f5"). InnerVolumeSpecName "kube-api-access-btdv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:34:02.692625 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.692551 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6c0915e3-471e-4f06-95fd-d75e42d526f5" (UID: "6c0915e3-471e-4f06-95fd-d75e42d526f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:34:02.791277 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.791250 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-service-ca\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:02.791277 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.791273 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btdv9\" (UniqueName: \"kubernetes.io/projected/6c0915e3-471e-4f06-95fd-d75e42d526f5-kube-api-access-btdv9\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:02.791277 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.791282 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:02.791534 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.791291 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-trusted-ca-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:02.791534 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.791305 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6c0915e3-471e-4f06-95fd-d75e42d526f5-oauth-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:02.791534 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.791315 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-oauth-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:02.791534 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:02.791344 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6c0915e3-471e-4f06-95fd-d75e42d526f5-console-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:03.505626 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:03.505591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5764894b74-9b5fp" event={"ID":"6c0915e3-471e-4f06-95fd-d75e42d526f5","Type":"ContainerDied","Data":"43fd937ac868832121fa5973b6fd77b21799b69f94ffa5378a73c4ca8836d24d"} Jul 03 20:34:03.505626 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:03.505614 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5764894b74-9b5fp" Jul 03 20:34:03.506132 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:03.505655 2578 scope.go:117] "RemoveContainer" containerID="99e1457f8108cbffc9371d8927f1382c3c9526d3650205599103f803fafbc55f" Jul 03 20:34:03.522478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:03.522454 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5764894b74-9b5fp"] Jul 03 20:34:03.526604 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:03.526582 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5764894b74-9b5fp"] Jul 03 20:34:04.753614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:04.753585 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0915e3-471e-4f06-95fd-d75e42d526f5" path="/var/lib/kubelet/pods/6c0915e3-471e-4f06-95fd-d75e42d526f5/volumes" Jul 03 20:34:06.301555 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:06.301528 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mrnzz" Jul 03 20:34:12.536143 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.536106 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5979fcdf8b-bh5f5" podUID="61d2d8ad-8edf-4269-9660-c63ef7b62eef" containerName="console" containerID="cri-o://c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb" gracePeriod=15 Jul 03 20:34:12.775270 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.775243 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:34:12.871935 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.871835 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6svrz\" (UniqueName: \"kubernetes.io/projected/61d2d8ad-8edf-4269-9660-c63ef7b62eef-kube-api-access-6svrz\") pod \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " Jul 03 20:34:12.871935 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.871898 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-serving-cert\") pod \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " Jul 03 20:34:12.871935 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.871915 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-oauth-config\") pod \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " Jul 03 20:34:12.872217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.871982 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-oauth-serving-cert\") pod \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " Jul 03 20:34:12.872217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.872035 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-service-ca\") pod \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " Jul 03 20:34:12.872217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.872066 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-config\") pod \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\" (UID: \"61d2d8ad-8edf-4269-9660-c63ef7b62eef\") " Jul 03 20:34:12.872432 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.872407 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-service-ca" (OuterVolumeSpecName: "service-ca") pod "61d2d8ad-8edf-4269-9660-c63ef7b62eef" (UID: "61d2d8ad-8edf-4269-9660-c63ef7b62eef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:34:12.872432 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.872416 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "61d2d8ad-8edf-4269-9660-c63ef7b62eef" (UID: "61d2d8ad-8edf-4269-9660-c63ef7b62eef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:34:12.872540 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.872453 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-config" (OuterVolumeSpecName: "console-config") pod "61d2d8ad-8edf-4269-9660-c63ef7b62eef" (UID: "61d2d8ad-8edf-4269-9660-c63ef7b62eef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:34:12.874268 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.874243 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "61d2d8ad-8edf-4269-9660-c63ef7b62eef" (UID: "61d2d8ad-8edf-4269-9660-c63ef7b62eef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:34:12.874361 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.874296 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61d2d8ad-8edf-4269-9660-c63ef7b62eef-kube-api-access-6svrz" (OuterVolumeSpecName: "kube-api-access-6svrz") pod "61d2d8ad-8edf-4269-9660-c63ef7b62eef" (UID: "61d2d8ad-8edf-4269-9660-c63ef7b62eef"). InnerVolumeSpecName "kube-api-access-6svrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:34:12.874361 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.874305 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "61d2d8ad-8edf-4269-9660-c63ef7b62eef" (UID: "61d2d8ad-8edf-4269-9660-c63ef7b62eef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:34:12.973706 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.973654 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6svrz\" (UniqueName: \"kubernetes.io/projected/61d2d8ad-8edf-4269-9660-c63ef7b62eef-kube-api-access-6svrz\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:12.973706 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.973705 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:12.973904 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.973717 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-oauth-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:12.973904 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.973725 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-oauth-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:12.973904 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.973736 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-service-ca\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:12.973904 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:12.973743 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/61d2d8ad-8edf-4269-9660-c63ef7b62eef-console-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:34:13.550647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.550611 2578 generic.go:356] "Generic (PLEG): container finished" podID="61d2d8ad-8edf-4269-9660-c63ef7b62eef" containerID="c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb" exitCode=0 Jul 03 20:34:13.550647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.550652 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5979fcdf8b-bh5f5" Jul 03 20:34:13.551145 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.550711 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5979fcdf8b-bh5f5" event={"ID":"61d2d8ad-8edf-4269-9660-c63ef7b62eef","Type":"ContainerDied","Data":"c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb"} Jul 03 20:34:13.551145 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.550760 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5979fcdf8b-bh5f5" event={"ID":"61d2d8ad-8edf-4269-9660-c63ef7b62eef","Type":"ContainerDied","Data":"979095170aec0135cdbf19aec87b679bbf9204ba5ddb20aea2e026fcc1146bd3"} Jul 03 20:34:13.551145 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.550780 2578 scope.go:117] "RemoveContainer" containerID="c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb" Jul 03 20:34:13.559538 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.559522 2578 scope.go:117] "RemoveContainer" containerID="c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb" Jul 03 20:34:13.559785 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:34:13.559765 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb\": container with ID starting with c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb not found: ID does not exist" containerID="c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb" Jul 03 20:34:13.559841 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.559794 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb"} err="failed to get container status \"c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb\": rpc error: code = NotFound desc = could not find container \"c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb\": container with ID starting with c9022725b0a047152dab1d7dfeb5af8d8033e90c1fec5b98bf4e0185148249fb not found: ID does not exist" Jul 03 20:34:13.570482 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.570455 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5979fcdf8b-bh5f5"] Jul 03 20:34:13.574288 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:13.574266 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5979fcdf8b-bh5f5"] Jul 03 20:34:14.755065 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:14.755030 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61d2d8ad-8edf-4269-9660-c63ef7b62eef" path="/var/lib/kubelet/pods/61d2d8ad-8edf-4269-9660-c63ef7b62eef/volumes" Jul 03 20:34:15.389405 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:15.389377 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:15.441537 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:15.441507 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:16.601144 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:16.601114 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:34:16.605057 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:16.605035 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76bd84d-7kljq" Jul 03 20:34:17.668562 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:17.668531 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:17.768592 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:17.768560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:32.003643 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:32.003612 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:37.452949 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:37.452913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:37.553579 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:37.553546 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:51.028411 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:51.028375 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:51.364042 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:51.363922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:56.128143 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.128103 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9"] Jul 03 20:34:56.128616 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.128559 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61d2d8ad-8edf-4269-9660-c63ef7b62eef" containerName="console" Jul 03 20:34:56.128616 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.128575 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="61d2d8ad-8edf-4269-9660-c63ef7b62eef" containerName="console" Jul 03 20:34:56.128616 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.128593 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0915e3-471e-4f06-95fd-d75e42d526f5" containerName="console" Jul 03 20:34:56.128616 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.128601 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0915e3-471e-4f06-95fd-d75e42d526f5" containerName="console" Jul 03 20:34:56.128840 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.128675 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0915e3-471e-4f06-95fd-d75e42d526f5" containerName="console" Jul 03 20:34:56.128840 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.128706 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="61d2d8ad-8edf-4269-9660-c63ef7b62eef" containerName="console" Jul 03 20:34:56.131330 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.131311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.134218 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.134199 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 03 20:34:56.134436 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.134418 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 03 20:34:56.134548 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.134491 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 03 20:34:56.134548 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.134418 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 03 20:34:56.134669 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.134571 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 03 20:34:56.134669 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.134619 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qx5sd\"" Jul 03 20:34:56.141165 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.141142 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 03 20:34:56.146991 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.146968 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9"] Jul 03 20:34:56.226610 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-telemeter-client-tls\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.226822 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226622 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.226822 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226647 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-serving-certs-ca-bundle\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.226822 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226735 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4ntr\" (UniqueName: \"kubernetes.io/projected/3225f018-d309-40cf-ac5e-849420cbaa07-kube-api-access-n4ntr\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.226822 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226763 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-secret-telemeter-client\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.227036 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226857 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-federate-client-tls\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.227036 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226925 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.227036 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.226959 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-metrics-client-ca\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328296 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-telemeter-client-tls\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328304 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328327 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-serving-certs-ca-bundle\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328351 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4ntr\" (UniqueName: \"kubernetes.io/projected/3225f018-d309-40cf-ac5e-849420cbaa07-kube-api-access-n4ntr\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-secret-telemeter-client\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328396 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-federate-client-tls\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328429 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.328483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.328446 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-metrics-client-ca\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.329231 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.329201 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-serving-certs-ca-bundle\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.329231 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.329224 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-metrics-client-ca\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.329408 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.329307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3225f018-d309-40cf-ac5e-849420cbaa07-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.330908 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.330881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-federate-client-tls\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.330998 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.330961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-telemeter-client-tls\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.331198 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.331181 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-secret-telemeter-client\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.331315 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.331293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3225f018-d309-40cf-ac5e-849420cbaa07-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.339587 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.339565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4ntr\" (UniqueName: \"kubernetes.io/projected/3225f018-d309-40cf-ac5e-849420cbaa07-kube-api-access-n4ntr\") pod \"telemeter-client-8bf7ff5b8-7npj9\" (UID: \"3225f018-d309-40cf-ac5e-849420cbaa07\") " pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.443629 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.443597 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" Jul 03 20:34:56.578675 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.578648 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9"] Jul 03 20:34:56.580278 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:34:56.580252 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3225f018_d309_40cf_ac5e_849420cbaa07.slice/crio-98f7688987ead69c1f92411d7835f358b2a2fb02bf8d64caa597eccb0ec1b7d9 WatchSource:0}: Error finding container 98f7688987ead69c1f92411d7835f358b2a2fb02bf8d64caa597eccb0ec1b7d9: Status 404 returned error can't find the container with id 98f7688987ead69c1f92411d7835f358b2a2fb02bf8d64caa597eccb0ec1b7d9 Jul 03 20:34:56.716378 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:56.716301 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" event={"ID":"3225f018-d309-40cf-ac5e-849420cbaa07","Type":"ContainerStarted","Data":"98f7688987ead69c1f92411d7835f358b2a2fb02bf8d64caa597eccb0ec1b7d9"} Jul 03 20:34:58.728266 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:58.728228 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" event={"ID":"3225f018-d309-40cf-ac5e-849420cbaa07","Type":"ContainerStarted","Data":"674802e8bfa2a22fc5175f15d3016c7de341fa72bc4e796e056823f23451053e"} Jul 03 20:34:58.728631 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:58.728295 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" event={"ID":"3225f018-d309-40cf-ac5e-849420cbaa07","Type":"ContainerStarted","Data":"828350c0bc00ace744d4ed946a45520748662145af6f3a9f938d4c8f30938acb"} Jul 03 20:34:58.728631 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:58.728323 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" event={"ID":"3225f018-d309-40cf-ac5e-849420cbaa07","Type":"ContainerStarted","Data":"3fe39496953735fd91d7b3e5b751d44fb1993d03af24c7d64ae44b3b32c2b077"} Jul 03 20:34:58.750894 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:58.750840 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8bf7ff5b8-7npj9" podStartSLOduration=0.971896506 podStartE2EDuration="2.750820867s" totalImagesPullingTime="1.778924361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:34:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:34:58.74978356 +0000 UTC m=+155.658645003" watchObservedRunningTime="2026-07-03 20:34:58.750820867 +0000 UTC m=+155.659682309" Jul 03 20:34:59.470480 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.470443 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dbbf954c6-66hxh"] Jul 03 20:34:59.472677 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.472662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.484562 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.484536 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbbf954c6-66hxh"] Jul 03 20:34:59.557322 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.557280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-service-ca\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.557481 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.557343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-oauth-config\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.557481 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.557384 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-serving-cert\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.557481 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.557408 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnrzz\" (UniqueName: \"kubernetes.io/projected/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-kube-api-access-wnrzz\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.557641 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.557493 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-config\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.557641 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.557524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-trusted-ca-bundle\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.557641 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.557607 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-oauth-serving-cert\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.591087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.591041 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:59.658463 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.658428 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-oauth-config\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.658656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.658473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-serving-cert\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.658656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.658495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnrzz\" (UniqueName: \"kubernetes.io/projected/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-kube-api-access-wnrzz\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.658656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.658538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-config\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.658656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.658560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-trusted-ca-bundle\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.658656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.658594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-oauth-serving-cert\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.658656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.658646 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-service-ca\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.659391 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.659368 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-service-ca\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.659467 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.659400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-config\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.659467 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.659400 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-oauth-serving-cert\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.659574 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.659556 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-trusted-ca-bundle\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.660994 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.660972 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-oauth-config\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.661295 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.661278 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-serving-cert\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.666425 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.666408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnrzz\" (UniqueName: \"kubernetes.io/projected/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-kube-api-access-wnrzz\") pod \"console-6dbbf954c6-66hxh\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.692561 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.692537 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:59.782730 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.782651 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:34:59.792638 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.792613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:34:59.910156 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:34:59.910127 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dbbf954c6-66hxh"] Jul 03 20:34:59.913647 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:34:59.913623 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebb9d370_5445_4ce8_88ea_c52a38fa5fcd.slice/crio-3613f546460573b9948abdaadcf9de85bb875e63a730c31ff54dfd5334345652 WatchSource:0}: Error finding container 3613f546460573b9948abdaadcf9de85bb875e63a730c31ff54dfd5334345652: Status 404 returned error can't find the container with id 3613f546460573b9948abdaadcf9de85bb875e63a730c31ff54dfd5334345652 Jul 03 20:35:00.277922 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:00.277881 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:00.334003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:00.333972 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:00.736878 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:00.736850 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbbf954c6-66hxh" event={"ID":"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd","Type":"ContainerStarted","Data":"ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782"} Jul 03 20:35:00.737045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:00.736898 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbbf954c6-66hxh" event={"ID":"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd","Type":"ContainerStarted","Data":"3613f546460573b9948abdaadcf9de85bb875e63a730c31ff54dfd5334345652"} Jul 03 20:35:00.755750 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:00.755706 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dbbf954c6-66hxh" podStartSLOduration=1.75567137 podStartE2EDuration="1.75567137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:35:00.754191593 +0000 UTC m=+157.663053035" watchObservedRunningTime="2026-07-03 20:35:00.75567137 +0000 UTC m=+157.664532846" Jul 03 20:35:06.285271 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:06.285235 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:06.344465 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:06.344437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:09.783337 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:09.783308 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:35:09.783765 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:09.783457 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:35:09.788005 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:09.787983 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:35:10.779586 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:10.779562 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:35:10.830750 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:10.830711 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8657d5d55-p7q65"] Jul 03 20:35:10.963255 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:10.963219 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-748b4f84c9-srs6b"] Jul 03 20:35:10.965559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:10.965539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:10.969816 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:10.969794 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:10.975810 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:10.975792 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748b4f84c9-srs6b"] Jul 03 20:35:11.031406 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.031311 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:11.051487 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.051458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-serving-cert\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.051616 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.051497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-trusted-ca-bundle\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.051616 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.051551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lthr\" (UniqueName: \"kubernetes.io/projected/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-kube-api-access-6lthr\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.051616 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.051580 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-oauth-config\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.051757 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.051668 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-service-ca\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.051757 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.051714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-oauth-serving-cert\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.051859 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.051806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-config\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.152942 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.152887 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-config\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.152958 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-serving-cert\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.152989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-trusted-ca-bundle\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153142 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153029 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lthr\" (UniqueName: \"kubernetes.io/projected/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-kube-api-access-6lthr\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153314 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153143 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-oauth-config\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153314 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-service-ca\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153314 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153235 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-oauth-serving-cert\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153815 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-config\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.153944 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-trusted-ca-bundle\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.154013 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153949 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-oauth-serving-cert\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.154013 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.153949 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-service-ca\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.155525 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.155502 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-oauth-config\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.155622 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.155596 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-serving-cert\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.161453 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.161429 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lthr\" (UniqueName: \"kubernetes.io/projected/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-kube-api-access-6lthr\") pod \"console-748b4f84c9-srs6b\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.276614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.276571 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:11.281572 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.281495 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:11.415132 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.415108 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-748b4f84c9-srs6b"] Jul 03 20:35:11.420585 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:35:11.420556 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a4b9cb_d6a5_454c_a6cf_c93cda95825e.slice/crio-481b182549d9e89891fb044c1d21228ef7aba0fe2b229e7f603267864ea9d9cb WatchSource:0}: Error finding container 481b182549d9e89891fb044c1d21228ef7aba0fe2b229e7f603267864ea9d9cb: Status 404 returned error can't find the container with id 481b182549d9e89891fb044c1d21228ef7aba0fe2b229e7f603267864ea9d9cb Jul 03 20:35:11.781529 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.781486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748b4f84c9-srs6b" event={"ID":"03a4b9cb-d6a5-454c-a6cf-c93cda95825e","Type":"ContainerStarted","Data":"8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b"} Jul 03 20:35:11.781760 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.781541 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748b4f84c9-srs6b" event={"ID":"03a4b9cb-d6a5-454c-a6cf-c93cda95825e","Type":"ContainerStarted","Data":"481b182549d9e89891fb044c1d21228ef7aba0fe2b229e7f603267864ea9d9cb"} Jul 03 20:35:11.799896 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:11.799842 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-748b4f84c9-srs6b" podStartSLOduration=1.799826281 podStartE2EDuration="1.799826281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:35:11.799311571 +0000 UTC m=+168.708173014" watchObservedRunningTime="2026-07-03 20:35:11.799826281 +0000 UTC m=+168.708687722" Jul 03 20:35:15.969030 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:15.968955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:18.315607 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:18.315569 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:18.416194 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:18.416133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:21.277491 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:21.277437 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:21.277491 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:21.277512 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:21.282526 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:21.282497 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:21.826059 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:21.826012 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:35:21.867072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:21.867032 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbbf954c6-66hxh"] Jul 03 20:35:22.000771 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:22.000743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:22.061966 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:22.061932 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:22.115466 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:22.115356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:30.410516 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:30.410466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:30.512172 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:30.512139 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:35.854153 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:35.854105 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8657d5d55-p7q65" podUID="c23f289b-12e1-4412-a680-2200eb2ccb12" containerName="console" containerID="cri-o://f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348" gracePeriod=15 Jul 03 20:35:36.096244 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.096220 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:35:36.272225 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272183 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-oauth-serving-cert\") pod \"c23f289b-12e1-4412-a680-2200eb2ccb12\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " Jul 03 20:35:36.272225 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272226 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-service-ca\") pod \"c23f289b-12e1-4412-a680-2200eb2ccb12\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " Jul 03 20:35:36.272478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272267 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77hdf\" (UniqueName: \"kubernetes.io/projected/c23f289b-12e1-4412-a680-2200eb2ccb12-kube-api-access-77hdf\") pod \"c23f289b-12e1-4412-a680-2200eb2ccb12\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " Jul 03 20:35:36.272478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272389 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-oauth-config\") pod \"c23f289b-12e1-4412-a680-2200eb2ccb12\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " Jul 03 20:35:36.272478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272430 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-serving-cert\") pod \"c23f289b-12e1-4412-a680-2200eb2ccb12\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " Jul 03 20:35:36.272478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272471 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-console-config\") pod \"c23f289b-12e1-4412-a680-2200eb2ccb12\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " Jul 03 20:35:36.272674 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272505 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-trusted-ca-bundle\") pod \"c23f289b-12e1-4412-a680-2200eb2ccb12\" (UID: \"c23f289b-12e1-4412-a680-2200eb2ccb12\") " Jul 03 20:35:36.272674 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272602 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c23f289b-12e1-4412-a680-2200eb2ccb12" (UID: "c23f289b-12e1-4412-a680-2200eb2ccb12"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:36.272674 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272650 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-service-ca" (OuterVolumeSpecName: "service-ca") pod "c23f289b-12e1-4412-a680-2200eb2ccb12" (UID: "c23f289b-12e1-4412-a680-2200eb2ccb12"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:36.272937 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272909 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-console-config" (OuterVolumeSpecName: "console-config") pod "c23f289b-12e1-4412-a680-2200eb2ccb12" (UID: "c23f289b-12e1-4412-a680-2200eb2ccb12"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:36.273004 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272976 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-oauth-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:36.273004 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272992 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-service-ca\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:36.273004 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.272975 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c23f289b-12e1-4412-a680-2200eb2ccb12" (UID: "c23f289b-12e1-4412-a680-2200eb2ccb12"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:36.274407 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.274385 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23f289b-12e1-4412-a680-2200eb2ccb12-kube-api-access-77hdf" (OuterVolumeSpecName: "kube-api-access-77hdf") pod "c23f289b-12e1-4412-a680-2200eb2ccb12" (UID: "c23f289b-12e1-4412-a680-2200eb2ccb12"). InnerVolumeSpecName "kube-api-access-77hdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:35:36.274881 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.274862 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c23f289b-12e1-4412-a680-2200eb2ccb12" (UID: "c23f289b-12e1-4412-a680-2200eb2ccb12"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:35:36.274936 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.274879 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c23f289b-12e1-4412-a680-2200eb2ccb12" (UID: "c23f289b-12e1-4412-a680-2200eb2ccb12"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:35:36.373959 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.373926 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77hdf\" (UniqueName: \"kubernetes.io/projected/c23f289b-12e1-4412-a680-2200eb2ccb12-kube-api-access-77hdf\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:36.373959 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.373953 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-oauth-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:36.373959 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.373963 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c23f289b-12e1-4412-a680-2200eb2ccb12-console-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:36.373959 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.373971 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-console-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:36.374219 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.373979 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c23f289b-12e1-4412-a680-2200eb2ccb12-trusted-ca-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:36.884947 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.884916 2578 generic.go:356] "Generic (PLEG): container finished" podID="c23f289b-12e1-4412-a680-2200eb2ccb12" containerID="f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348" exitCode=0 Jul 03 20:35:36.885416 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.884954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8657d5d55-p7q65" event={"ID":"c23f289b-12e1-4412-a680-2200eb2ccb12","Type":"ContainerDied","Data":"f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348"} Jul 03 20:35:36.885416 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.884960 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8657d5d55-p7q65" Jul 03 20:35:36.885416 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.884997 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8657d5d55-p7q65" event={"ID":"c23f289b-12e1-4412-a680-2200eb2ccb12","Type":"ContainerDied","Data":"5cbd3b14c74dee9aae63c1d9b2d8bf334a52c968d3ac762b7ee029415af71796"} Jul 03 20:35:36.885416 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.885019 2578 scope.go:117] "RemoveContainer" containerID="f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348" Jul 03 20:35:36.893065 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.893050 2578 scope.go:117] "RemoveContainer" containerID="f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348" Jul 03 20:35:36.893330 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:35:36.893313 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348\": container with ID starting with f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348 not found: ID does not exist" containerID="f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348" Jul 03 20:35:36.893380 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.893337 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348"} err="failed to get container status \"f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348\": rpc error: code = NotFound desc = could not find container \"f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348\": container with ID starting with f8939afe3d18c60c4096f940e7634ee413877375752e6883a7efafc548629348 not found: ID does not exist" Jul 03 20:35:36.903354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.903323 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8657d5d55-p7q65"] Jul 03 20:35:36.905723 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:36.905697 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8657d5d55-p7q65"] Jul 03 20:35:38.754140 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:38.754111 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c23f289b-12e1-4412-a680-2200eb2ccb12" path="/var/lib/kubelet/pods/c23f289b-12e1-4412-a680-2200eb2ccb12/volumes" Jul 03 20:35:46.888790 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:46.888721 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dbbf954c6-66hxh" podUID="ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" containerName="console" containerID="cri-o://ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782" gracePeriod=15 Jul 03 20:35:47.120366 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.120345 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:35:47.165933 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.165870 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-config\") pod \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " Jul 03 20:35:47.165933 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.165902 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-oauth-serving-cert\") pod \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " Jul 03 20:35:47.165933 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.165929 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-trusted-ca-bundle\") pod \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " Jul 03 20:35:47.166177 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.165950 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-service-ca\") pod \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " Jul 03 20:35:47.166177 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.165978 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-oauth-config\") pod \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " Jul 03 20:35:47.166177 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.165995 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-serving-cert\") pod \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " Jul 03 20:35:47.166177 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.166050 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnrzz\" (UniqueName: \"kubernetes.io/projected/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-kube-api-access-wnrzz\") pod \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\" (UID: \"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd\") " Jul 03 20:35:47.166387 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.166323 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-config" (OuterVolumeSpecName: "console-config") pod "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" (UID: "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:47.166387 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.166337 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" (UID: "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:47.166387 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.166374 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-service-ca" (OuterVolumeSpecName: "service-ca") pod "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" (UID: "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:47.166501 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.166390 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" (UID: "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:35:47.168203 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.168171 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" (UID: "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:35:47.168294 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.168262 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-kube-api-access-wnrzz" (OuterVolumeSpecName: "kube-api-access-wnrzz") pod "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" (UID: "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd"). InnerVolumeSpecName "kube-api-access-wnrzz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:35:47.168334 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.168291 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" (UID: "ebb9d370-5445-4ce8-88ea-c52a38fa5fcd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:35:47.267493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.267449 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-service-ca\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:47.267493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.267488 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-oauth-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:47.267493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.267499 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:47.267493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.267508 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnrzz\" (UniqueName: \"kubernetes.io/projected/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-kube-api-access-wnrzz\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:47.267774 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.267518 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-console-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:47.267774 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.267526 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-oauth-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:47.267774 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.267534 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd-trusted-ca-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:35:47.927772 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.927733 2578 generic.go:356] "Generic (PLEG): container finished" podID="ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" containerID="ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782" exitCode=0 Jul 03 20:35:47.928232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.927779 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dbbf954c6-66hxh" Jul 03 20:35:47.928232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.927824 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbbf954c6-66hxh" event={"ID":"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd","Type":"ContainerDied","Data":"ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782"} Jul 03 20:35:47.928232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.927887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dbbf954c6-66hxh" event={"ID":"ebb9d370-5445-4ce8-88ea-c52a38fa5fcd","Type":"ContainerDied","Data":"3613f546460573b9948abdaadcf9de85bb875e63a730c31ff54dfd5334345652"} Jul 03 20:35:47.928232 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.927921 2578 scope.go:117] "RemoveContainer" containerID="ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782" Jul 03 20:35:47.936409 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.936387 2578 scope.go:117] "RemoveContainer" containerID="ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782" Jul 03 20:35:47.936631 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:35:47.936610 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782\": container with ID starting with ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782 not found: ID does not exist" containerID="ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782" Jul 03 20:35:47.936677 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.936640 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782"} err="failed to get container status \"ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782\": rpc error: code = NotFound desc = could not find container \"ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782\": container with ID starting with ca8377adc6c03d4795e2ad1da27f22876eeefcd08c60b87313dc19710046b782 not found: ID does not exist" Jul 03 20:35:47.948538 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.948517 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dbbf954c6-66hxh"] Jul 03 20:35:47.952266 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:47.952243 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dbbf954c6-66hxh"] Jul 03 20:35:48.754595 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:48.754562 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" path="/var/lib/kubelet/pods/ebb9d370-5445-4ce8-88ea-c52a38fa5fcd/volumes" Jul 03 20:35:55.623665 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:55.623633 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:35:55.685853 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:35:55.685823 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:28.065911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.065856 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:28.167900 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.167871 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:28.357962 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.357857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:28.884122 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.884092 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2"] Jul 03 20:36:28.884420 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.884409 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c23f289b-12e1-4412-a680-2200eb2ccb12" containerName="console" Jul 03 20:36:28.884466 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.884422 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c23f289b-12e1-4412-a680-2200eb2ccb12" containerName="console" Jul 03 20:36:28.884466 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.884435 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" containerName="console" Jul 03 20:36:28.884466 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.884441 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" containerName="console" Jul 03 20:36:28.884553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.884493 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebb9d370-5445-4ce8-88ea-c52a38fa5fcd" containerName="console" Jul 03 20:36:28.884553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.884500 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c23f289b-12e1-4412-a680-2200eb2ccb12" containerName="console" Jul 03 20:36:28.888822 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.888802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:28.891749 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.891732 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 03 20:36:28.891835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.891732 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 03 20:36:28.891835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.891799 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w9mdq\"" Jul 03 20:36:28.898601 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:28.898577 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2"] Jul 03 20:36:29.017540 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.017505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.017540 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.017546 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjxk\" (UniqueName: \"kubernetes.io/projected/a21cde88-f4fc-4924-90e2-c483b1a812f7-kube-api-access-fnjxk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.017797 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.017596 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.118314 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.118274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.118671 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.118320 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjxk\" (UniqueName: \"kubernetes.io/projected/a21cde88-f4fc-4924-90e2-c483b1a812f7-kube-api-access-fnjxk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.118671 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.118392 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.118671 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.118653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.118813 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.118677 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.127069 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.127041 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjxk\" (UniqueName: \"kubernetes.io/projected/a21cde88-f4fc-4924-90e2-c483b1a812f7-kube-api-access-fnjxk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.197913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.197886 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:29.326978 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:29.326936 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2"] Jul 03 20:36:29.329594 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:36:29.329565 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda21cde88_f4fc_4924_90e2_c483b1a812f7.slice/crio-00ef5b95751e832cb6744ed3b07a32d5dabf1e44d16676599c651c3145b3ef40 WatchSource:0}: Error finding container 00ef5b95751e832cb6744ed3b07a32d5dabf1e44d16676599c651c3145b3ef40: Status 404 returned error can't find the container with id 00ef5b95751e832cb6744ed3b07a32d5dabf1e44d16676599c651c3145b3ef40 Jul 03 20:36:30.092825 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:30.092785 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" event={"ID":"a21cde88-f4fc-4924-90e2-c483b1a812f7","Type":"ContainerStarted","Data":"00ef5b95751e832cb6744ed3b07a32d5dabf1e44d16676599c651c3145b3ef40"} Jul 03 20:36:30.992465 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:30.992417 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:31.053698 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:31.053655 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:35.117695 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:35.117642 2578 generic.go:356] "Generic (PLEG): container finished" podID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerID="1f77c5835742070da169f36ae7a970d04c34ee2cc7a2b100e2bed69adb19a4a5" exitCode=0 Jul 03 20:36:35.118107 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:35.117725 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" event={"ID":"a21cde88-f4fc-4924-90e2-c483b1a812f7","Type":"ContainerDied","Data":"1f77c5835742070da169f36ae7a970d04c34ee2cc7a2b100e2bed69adb19a4a5"} Jul 03 20:36:38.131410 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:38.131373 2578 generic.go:356] "Generic (PLEG): container finished" podID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerID="f6af04fb1106d0379e546e8be1d4149a86633357bb47761473da848908e0a1c5" exitCode=0 Jul 03 20:36:38.131799 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:38.131458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" event={"ID":"a21cde88-f4fc-4924-90e2-c483b1a812f7","Type":"ContainerDied","Data":"f6af04fb1106d0379e546e8be1d4149a86633357bb47761473da848908e0a1c5"} Jul 03 20:36:45.166797 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:45.166650 2578 generic.go:356] "Generic (PLEG): container finished" podID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerID="01e4ca222208561300f3c36f73f78bfd08801131c004add1b46d41925340b07f" exitCode=0 Jul 03 20:36:45.166797 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:45.166730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" event={"ID":"a21cde88-f4fc-4924-90e2-c483b1a812f7","Type":"ContainerDied","Data":"01e4ca222208561300f3c36f73f78bfd08801131c004add1b46d41925340b07f"} Jul 03 20:36:46.296839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.296810 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:46.367903 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.367863 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnjxk\" (UniqueName: \"kubernetes.io/projected/a21cde88-f4fc-4924-90e2-c483b1a812f7-kube-api-access-fnjxk\") pod \"a21cde88-f4fc-4924-90e2-c483b1a812f7\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " Jul 03 20:36:46.368105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.367949 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-bundle\") pod \"a21cde88-f4fc-4924-90e2-c483b1a812f7\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " Jul 03 20:36:46.368105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.367981 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-util\") pod \"a21cde88-f4fc-4924-90e2-c483b1a812f7\" (UID: \"a21cde88-f4fc-4924-90e2-c483b1a812f7\") " Jul 03 20:36:46.368572 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.368544 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-bundle" (OuterVolumeSpecName: "bundle") pod "a21cde88-f4fc-4924-90e2-c483b1a812f7" (UID: "a21cde88-f4fc-4924-90e2-c483b1a812f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:36:46.370079 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.370049 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a21cde88-f4fc-4924-90e2-c483b1a812f7-kube-api-access-fnjxk" (OuterVolumeSpecName: "kube-api-access-fnjxk") pod "a21cde88-f4fc-4924-90e2-c483b1a812f7" (UID: "a21cde88-f4fc-4924-90e2-c483b1a812f7"). InnerVolumeSpecName "kube-api-access-fnjxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:36:46.372736 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.372716 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-util" (OuterVolumeSpecName: "util") pod "a21cde88-f4fc-4924-90e2-c483b1a812f7" (UID: "a21cde88-f4fc-4924-90e2-c483b1a812f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:36:46.468511 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.468485 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnjxk\" (UniqueName: \"kubernetes.io/projected/a21cde88-f4fc-4924-90e2-c483b1a812f7-kube-api-access-fnjxk\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:36:46.468511 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.468508 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:36:46.468769 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:46.468517 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a21cde88-f4fc-4924-90e2-c483b1a812f7-util\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:36:47.175892 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:47.175865 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" event={"ID":"a21cde88-f4fc-4924-90e2-c483b1a812f7","Type":"ContainerDied","Data":"00ef5b95751e832cb6744ed3b07a32d5dabf1e44d16676599c651c3145b3ef40"} Jul 03 20:36:47.175892 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:47.175880 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e6754057xc2" Jul 03 20:36:47.176077 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:47.175908 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00ef5b95751e832cb6744ed3b07a32d5dabf1e44d16676599c651c3145b3ef40" Jul 03 20:36:49.920952 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:49.920920 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:50.731467 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:50.731437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:51.873021 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.872986 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg"] Jul 03 20:36:51.873393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.873299 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerName="extract" Jul 03 20:36:51.873393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.873312 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerName="extract" Jul 03 20:36:51.873393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.873325 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerName="pull" Jul 03 20:36:51.873393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.873331 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerName="pull" Jul 03 20:36:51.873393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.873353 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerName="util" Jul 03 20:36:51.873393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.873359 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerName="util" Jul 03 20:36:51.873603 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.873406 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a21cde88-f4fc-4924-90e2-c483b1a812f7" containerName="extract" Jul 03 20:36:51.921976 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.921947 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg"] Jul 03 20:36:51.922125 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.922040 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:51.924672 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.924650 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 03 20:36:51.924810 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.924673 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 03 20:36:51.924810 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:51.924710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lxl7w\"" Jul 03 20:36:52.015433 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.015397 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342abc92-24f7-4ad5-9553-a3fc1533eb3f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj4gg\" (UID: \"342abc92-24f7-4ad5-9553-a3fc1533eb3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:52.015592 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.015444 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lb5j\" (UniqueName: \"kubernetes.io/projected/342abc92-24f7-4ad5-9553-a3fc1533eb3f-kube-api-access-2lb5j\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj4gg\" (UID: \"342abc92-24f7-4ad5-9553-a3fc1533eb3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:52.116030 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.115989 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lb5j\" (UniqueName: \"kubernetes.io/projected/342abc92-24f7-4ad5-9553-a3fc1533eb3f-kube-api-access-2lb5j\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj4gg\" (UID: \"342abc92-24f7-4ad5-9553-a3fc1533eb3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:52.116170 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.116094 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342abc92-24f7-4ad5-9553-a3fc1533eb3f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj4gg\" (UID: \"342abc92-24f7-4ad5-9553-a3fc1533eb3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:52.116506 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.116490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342abc92-24f7-4ad5-9553-a3fc1533eb3f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj4gg\" (UID: \"342abc92-24f7-4ad5-9553-a3fc1533eb3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:52.124136 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.124078 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lb5j\" (UniqueName: \"kubernetes.io/projected/342abc92-24f7-4ad5-9553-a3fc1533eb3f-kube-api-access-2lb5j\") pod \"cert-manager-operator-controller-manager-55c444bf86-tj4gg\" (UID: \"342abc92-24f7-4ad5-9553-a3fc1533eb3f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:52.231353 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.231318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" Jul 03 20:36:52.380920 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:52.380844 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg"] Jul 03 20:36:52.384220 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:36:52.384194 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342abc92_24f7_4ad5_9553_a3fc1533eb3f.slice/crio-8d09bb0ed46ef2d761fe0fcebbb79b7d8e5d9c3ddb8e167262ddb0ac749a5e5f WatchSource:0}: Error finding container 8d09bb0ed46ef2d761fe0fcebbb79b7d8e5d9c3ddb8e167262ddb0ac749a5e5f: Status 404 returned error can't find the container with id 8d09bb0ed46ef2d761fe0fcebbb79b7d8e5d9c3ddb8e167262ddb0ac749a5e5f Jul 03 20:36:53.198835 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:53.198806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" event={"ID":"342abc92-24f7-4ad5-9553-a3fc1533eb3f","Type":"ContainerStarted","Data":"8d09bb0ed46ef2d761fe0fcebbb79b7d8e5d9c3ddb8e167262ddb0ac749a5e5f"} Jul 03 20:36:53.518951 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:53.518869 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:53.574283 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:53.574251 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:58.112968 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:58.112938 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:36:58.171164 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:36:58.171132 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:10.169427 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:10.169366 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:10.277306 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:10.277262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" event={"ID":"342abc92-24f7-4ad5-9553-a3fc1533eb3f","Type":"ContainerStarted","Data":"4ac31adea4f09b60b4b00ae25cbb1242ab62f1965fb3b4c5d144e028303aba8b"} Jul 03 20:37:10.277490 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:10.277344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:10.304909 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:10.304851 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-tj4gg" podStartSLOduration=2.230947242 podStartE2EDuration="19.304835898s" totalImagesPullingTime="17.073888656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:10.302807257 +0000 UTC m=+287.211668715" watchObservedRunningTime="2026-07-03 20:37:10.304835898 +0000 UTC m=+287.213697344" Jul 03 20:37:11.313039 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:11.313009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:12.174270 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.174237 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:12.334044 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.334014 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982"] Jul 03 20:37:12.336522 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.336503 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.339213 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.339194 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w9mdq\"" Jul 03 20:37:12.339333 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.339227 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 03 20:37:12.339333 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.339229 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 03 20:37:12.345083 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.345061 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982"] Jul 03 20:37:12.491054 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.491023 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.491310 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.491086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.491310 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.491126 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm6f8\" (UniqueName: \"kubernetes.io/projected/479c63d3-a76c-4de8-bb03-461f276d6e5f-kube-api-access-bm6f8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.570388 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.570358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:12.592337 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.592311 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.592483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.592343 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm6f8\" (UniqueName: \"kubernetes.io/projected/479c63d3-a76c-4de8-bb03-461f276d6e5f-kube-api-access-bm6f8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.592483 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.592403 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.592700 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.592665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.592769 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.592750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.600941 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.600915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm6f8\" (UniqueName: \"kubernetes.io/projected/479c63d3-a76c-4de8-bb03-461f276d6e5f-kube-api-access-bm6f8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.647072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.647036 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:12.779739 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:12.779716 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982"] Jul 03 20:37:12.782059 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:37:12.782033 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod479c63d3_a76c_4de8_bb03_461f276d6e5f.slice/crio-5e1c5ef24cee295afba178a45d164973214fd424096f7fb81bea90735159a616 WatchSource:0}: Error finding container 5e1c5ef24cee295afba178a45d164973214fd424096f7fb81bea90735159a616: Status 404 returned error can't find the container with id 5e1c5ef24cee295afba178a45d164973214fd424096f7fb81bea90735159a616 Jul 03 20:37:13.292626 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.292595 2578 generic.go:356] "Generic (PLEG): container finished" podID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerID="1f8c4b8075d8bae5988565bcd36000417e7a8b0f251ddb497d109f62afc46399" exitCode=0 Jul 03 20:37:13.292810 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.292703 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" event={"ID":"479c63d3-a76c-4de8-bb03-461f276d6e5f","Type":"ContainerDied","Data":"1f8c4b8075d8bae5988565bcd36000417e7a8b0f251ddb497d109f62afc46399"} Jul 03 20:37:13.292810 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.292794 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" event={"ID":"479c63d3-a76c-4de8-bb03-461f276d6e5f","Type":"ContainerStarted","Data":"5e1c5ef24cee295afba178a45d164973214fd424096f7fb81bea90735159a616"} Jul 03 20:37:13.407495 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.407465 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc"] Jul 03 20:37:13.409840 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.409823 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.412113 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.412094 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5kgmf\"" Jul 03 20:37:13.412245 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.412212 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 03 20:37:13.412481 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.412466 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 03 20:37:13.420216 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.420196 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc"] Jul 03 20:37:13.501049 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.501015 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx7n7\" (UniqueName: \"kubernetes.io/projected/327d92c6-f2ff-4481-ae51-e8d06bea842a-kube-api-access-zx7n7\") pod \"cert-manager-cainjector-559cdd8c87-2n9fc\" (UID: \"327d92c6-f2ff-4481-ae51-e8d06bea842a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.501257 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.501083 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/327d92c6-f2ff-4481-ae51-e8d06bea842a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2n9fc\" (UID: \"327d92c6-f2ff-4481-ae51-e8d06bea842a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.601762 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.601648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/327d92c6-f2ff-4481-ae51-e8d06bea842a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2n9fc\" (UID: \"327d92c6-f2ff-4481-ae51-e8d06bea842a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.601923 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.601766 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx7n7\" (UniqueName: \"kubernetes.io/projected/327d92c6-f2ff-4481-ae51-e8d06bea842a-kube-api-access-zx7n7\") pod \"cert-manager-cainjector-559cdd8c87-2n9fc\" (UID: \"327d92c6-f2ff-4481-ae51-e8d06bea842a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.610307 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.610280 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/327d92c6-f2ff-4481-ae51-e8d06bea842a-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-2n9fc\" (UID: \"327d92c6-f2ff-4481-ae51-e8d06bea842a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.610428 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.610341 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx7n7\" (UniqueName: \"kubernetes.io/projected/327d92c6-f2ff-4481-ae51-e8d06bea842a-kube-api-access-zx7n7\") pod \"cert-manager-cainjector-559cdd8c87-2n9fc\" (UID: \"327d92c6-f2ff-4481-ae51-e8d06bea842a\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.730657 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.730624 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" Jul 03 20:37:13.855579 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:13.855506 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc"] Jul 03 20:37:13.858888 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:37:13.858859 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod327d92c6_f2ff_4481_ae51_e8d06bea842a.slice/crio-7ac27465a7050c74e52afff32d054336eb4020d49f055a1951d67256aedbc3c4 WatchSource:0}: Error finding container 7ac27465a7050c74e52afff32d054336eb4020d49f055a1951d67256aedbc3c4: Status 404 returned error can't find the container with id 7ac27465a7050c74e52afff32d054336eb4020d49f055a1951d67256aedbc3c4 Jul 03 20:37:14.299675 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:14.299629 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" event={"ID":"327d92c6-f2ff-4481-ae51-e8d06bea842a","Type":"ContainerStarted","Data":"7ac27465a7050c74e52afff32d054336eb4020d49f055a1951d67256aedbc3c4"} Jul 03 20:37:17.315010 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:17.314972 2578 generic.go:356] "Generic (PLEG): container finished" podID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerID="f78394f0c1939c6374aa2b5c3c22637f7cba5544d742dd490113b0be2aaf1026" exitCode=0 Jul 03 20:37:17.315526 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:17.315010 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" event={"ID":"479c63d3-a76c-4de8-bb03-461f276d6e5f","Type":"ContainerDied","Data":"f78394f0c1939c6374aa2b5c3c22637f7cba5544d742dd490113b0be2aaf1026"} Jul 03 20:37:17.316761 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:17.316591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" event={"ID":"327d92c6-f2ff-4481-ae51-e8d06bea842a","Type":"ContainerStarted","Data":"9b23e0ece45c3c5e9f944631c5226d98afcbd99b670c582f8f051388cb72a419"} Jul 03 20:37:17.352091 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:17.352043 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-2n9fc" podStartSLOduration=1.7837743050000001 podStartE2EDuration="4.352027232s" totalImagesPullingTime="2.568252927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:17.350077135 +0000 UTC m=+294.258938577" watchObservedRunningTime="2026-07-03 20:37:17.352027232 +0000 UTC m=+294.260888673" Jul 03 20:37:18.148735 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.148700 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-676hx"] Jul 03 20:37:18.150892 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.150878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.153194 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.153170 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-ckw6w\"" Jul 03 20:37:18.161145 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.161125 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-676hx"] Jul 03 20:37:18.250231 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.250194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w27fs\" (UniqueName: \"kubernetes.io/projected/89070541-019b-4e9c-b4fa-173742a70836-kube-api-access-w27fs\") pod \"cert-manager-webhook-6486ffd997-676hx\" (UID: \"89070541-019b-4e9c-b4fa-173742a70836\") " pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.250425 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.250258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89070541-019b-4e9c-b4fa-173742a70836-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-676hx\" (UID: \"89070541-019b-4e9c-b4fa-173742a70836\") " pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.322727 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.322679 2578 generic.go:356] "Generic (PLEG): container finished" podID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerID="3564a387f615be218839272ecf0457963aab5b7f9a6120d7002f5dd6a23c7158" exitCode=0 Jul 03 20:37:18.323132 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.322763 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" event={"ID":"479c63d3-a76c-4de8-bb03-461f276d6e5f","Type":"ContainerDied","Data":"3564a387f615be218839272ecf0457963aab5b7f9a6120d7002f5dd6a23c7158"} Jul 03 20:37:18.350860 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.350833 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w27fs\" (UniqueName: \"kubernetes.io/projected/89070541-019b-4e9c-b4fa-173742a70836-kube-api-access-w27fs\") pod \"cert-manager-webhook-6486ffd997-676hx\" (UID: \"89070541-019b-4e9c-b4fa-173742a70836\") " pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.351026 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.350873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89070541-019b-4e9c-b4fa-173742a70836-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-676hx\" (UID: \"89070541-019b-4e9c-b4fa-173742a70836\") " pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.360807 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.360779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89070541-019b-4e9c-b4fa-173742a70836-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-676hx\" (UID: \"89070541-019b-4e9c-b4fa-173742a70836\") " pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.360926 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.360869 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w27fs\" (UniqueName: \"kubernetes.io/projected/89070541-019b-4e9c-b4fa-173742a70836-kube-api-access-w27fs\") pod \"cert-manager-webhook-6486ffd997-676hx\" (UID: \"89070541-019b-4e9c-b4fa-173742a70836\") " pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.459627 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.459598 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:18.586109 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.586077 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-676hx"] Jul 03 20:37:18.588475 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:37:18.588444 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89070541_019b_4e9c_b4fa_173742a70836.slice/crio-90a38bde0168248876e7a12e77c83f90e262b0ea5bd543fc97510af27a158987 WatchSource:0}: Error finding container 90a38bde0168248876e7a12e77c83f90e262b0ea5bd543fc97510af27a158987: Status 404 returned error can't find the container with id 90a38bde0168248876e7a12e77c83f90e262b0ea5bd543fc97510af27a158987 Jul 03 20:37:18.861314 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.861195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:18.964340 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:18.964306 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:19.330678 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.330648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" event={"ID":"89070541-019b-4e9c-b4fa-173742a70836","Type":"ContainerStarted","Data":"0ce569ac35bc28e19fd80dae07c9a18d718a128824faafc7ba3dc50911ea902d"} Jul 03 20:37:19.330678 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.330703 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" event={"ID":"89070541-019b-4e9c-b4fa-173742a70836","Type":"ContainerStarted","Data":"90a38bde0168248876e7a12e77c83f90e262b0ea5bd543fc97510af27a158987"} Jul 03 20:37:19.331128 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.331009 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:19.353978 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.353926 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" podStartSLOduration=1.3539101009999999 podStartE2EDuration="1.353910101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:19.352822021 +0000 UTC m=+296.261683465" watchObservedRunningTime="2026-07-03 20:37:19.353910101 +0000 UTC m=+296.262771542" Jul 03 20:37:19.461099 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.461073 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:19.562603 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.562569 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-bundle\") pod \"479c63d3-a76c-4de8-bb03-461f276d6e5f\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " Jul 03 20:37:19.562603 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.562606 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bm6f8\" (UniqueName: \"kubernetes.io/projected/479c63d3-a76c-4de8-bb03-461f276d6e5f-kube-api-access-bm6f8\") pod \"479c63d3-a76c-4de8-bb03-461f276d6e5f\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " Jul 03 20:37:19.562845 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.562647 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-util\") pod \"479c63d3-a76c-4de8-bb03-461f276d6e5f\" (UID: \"479c63d3-a76c-4de8-bb03-461f276d6e5f\") " Jul 03 20:37:19.563100 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.563077 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-bundle" (OuterVolumeSpecName: "bundle") pod "479c63d3-a76c-4de8-bb03-461f276d6e5f" (UID: "479c63d3-a76c-4de8-bb03-461f276d6e5f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:37:19.564676 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.564654 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/479c63d3-a76c-4de8-bb03-461f276d6e5f-kube-api-access-bm6f8" (OuterVolumeSpecName: "kube-api-access-bm6f8") pod "479c63d3-a76c-4de8-bb03-461f276d6e5f" (UID: "479c63d3-a76c-4de8-bb03-461f276d6e5f"). InnerVolumeSpecName "kube-api-access-bm6f8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:37:19.567906 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.567873 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-util" (OuterVolumeSpecName: "util") pod "479c63d3-a76c-4de8-bb03-461f276d6e5f" (UID: "479c63d3-a76c-4de8-bb03-461f276d6e5f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:37:19.663470 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.663362 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:37:19.663470 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.663409 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bm6f8\" (UniqueName: \"kubernetes.io/projected/479c63d3-a76c-4de8-bb03-461f276d6e5f-kube-api-access-bm6f8\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:37:19.663470 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:19.663423 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/479c63d3-a76c-4de8-bb03-461f276d6e5f-util\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:37:20.338014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:20.337981 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" Jul 03 20:37:20.338014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:20.337998 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56982" event={"ID":"479c63d3-a76c-4de8-bb03-461f276d6e5f","Type":"ContainerDied","Data":"5e1c5ef24cee295afba178a45d164973214fd424096f7fb81bea90735159a616"} Jul 03 20:37:20.338545 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:20.338036 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e1c5ef24cee295afba178a45d164973214fd424096f7fb81bea90735159a616" Jul 03 20:37:20.989304 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:20.989275 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:23.515814 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:23.515784 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:23.611146 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:23.611116 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:23.660603 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:23.660571 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:37:23.660792 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:23.660576 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:37:23.665238 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:23.665213 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 03 20:37:24.776359 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776331 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn"] Jul 03 20:37:24.829834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776634 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerName="extract" Jul 03 20:37:24.829834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776644 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerName="extract" Jul 03 20:37:24.829834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776657 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerName="pull" Jul 03 20:37:24.829834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776662 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerName="pull" Jul 03 20:37:24.829834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776695 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerName="util" Jul 03 20:37:24.829834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776700 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerName="util" Jul 03 20:37:24.829834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.776771 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="479c63d3-a76c-4de8-bb03-461f276d6e5f" containerName="extract" Jul 03 20:37:24.837006 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.836980 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn"] Jul 03 20:37:24.837098 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.837068 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:24.839669 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.839640 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 03 20:37:24.840657 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.840638 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-j9469\"" Jul 03 20:37:24.840771 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:24.840668 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 03 20:37:25.009267 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.009230 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlf6v\" (UniqueName: \"kubernetes.io/projected/f25e0d3c-d7b4-426c-8950-3cf5b3b15610-kube-api-access-tlf6v\") pod \"openshift-lws-operator-fd8ccff4c-ztwcn\" (UID: \"f25e0d3c-d7b4-426c-8950-3cf5b3b15610\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:25.009463 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.009279 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f25e0d3c-d7b4-426c-8950-3cf5b3b15610-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztwcn\" (UID: \"f25e0d3c-d7b4-426c-8950-3cf5b3b15610\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:25.110498 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.110411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlf6v\" (UniqueName: \"kubernetes.io/projected/f25e0d3c-d7b4-426c-8950-3cf5b3b15610-kube-api-access-tlf6v\") pod \"openshift-lws-operator-fd8ccff4c-ztwcn\" (UID: \"f25e0d3c-d7b4-426c-8950-3cf5b3b15610\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:25.110498 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.110459 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f25e0d3c-d7b4-426c-8950-3cf5b3b15610-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztwcn\" (UID: \"f25e0d3c-d7b4-426c-8950-3cf5b3b15610\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:25.110903 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.110884 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f25e0d3c-d7b4-426c-8950-3cf5b3b15610-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ztwcn\" (UID: \"f25e0d3c-d7b4-426c-8950-3cf5b3b15610\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:25.119296 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.119269 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlf6v\" (UniqueName: \"kubernetes.io/projected/f25e0d3c-d7b4-426c-8950-3cf5b3b15610-kube-api-access-tlf6v\") pod \"openshift-lws-operator-fd8ccff4c-ztwcn\" (UID: \"f25e0d3c-d7b4-426c-8950-3cf5b3b15610\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:25.146127 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.146097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" Jul 03 20:37:25.286746 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.286723 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn"] Jul 03 20:37:25.289034 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:37:25.289008 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf25e0d3c_d7b4_426c_8950_3cf5b3b15610.slice/crio-22856bcfd4b356c6650314a75f88a3a2324ea15d29764e18ff6eac2972e081df WatchSource:0}: Error finding container 22856bcfd4b356c6650314a75f88a3a2324ea15d29764e18ff6eac2972e081df: Status 404 returned error can't find the container with id 22856bcfd4b356c6650314a75f88a3a2324ea15d29764e18ff6eac2972e081df Jul 03 20:37:25.340795 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.340761 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-676hx" Jul 03 20:37:25.361352 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:25.361243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" event={"ID":"f25e0d3c-d7b4-426c-8950-3cf5b3b15610","Type":"ContainerStarted","Data":"22856bcfd4b356c6650314a75f88a3a2324ea15d29764e18ff6eac2972e081df"} Jul 03 20:37:27.382824 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:27.381801 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" event={"ID":"f25e0d3c-d7b4-426c-8950-3cf5b3b15610","Type":"ContainerStarted","Data":"fc5b74e1a789859c57ab5340d541e7c8c45411bb6c1650df12a4332ea9813efe"} Jul 03 20:37:27.400593 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:27.400535 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ztwcn" podStartSLOduration=1.621602043 podStartE2EDuration="3.400514103s" totalImagesPullingTime="1.77891206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:27.397816507 +0000 UTC m=+304.306677951" watchObservedRunningTime="2026-07-03 20:37:27.400514103 +0000 UTC m=+304.309375546" Jul 03 20:37:28.080905 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:28.080873 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:28.181895 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:28.181863 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:30.285084 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.285050 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx"] Jul 03 20:37:30.287572 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.287555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.290456 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.290437 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-w9mdq\"" Jul 03 20:37:30.290653 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.290639 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 03 20:37:30.291537 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.291524 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 03 20:37:30.300609 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.300587 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx"] Jul 03 20:37:30.353490 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.353458 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.353635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.353519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsz9d\" (UniqueName: \"kubernetes.io/projected/abe364ab-f3a4-42ae-acea-b97d69b3b969-kube-api-access-tsz9d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.353635 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.353562 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.404303 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.404266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:30.454380 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.454350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.454554 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.454409 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsz9d\" (UniqueName: \"kubernetes.io/projected/abe364ab-f3a4-42ae-acea-b97d69b3b969-kube-api-access-tsz9d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.454554 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.454435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.454851 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.454829 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.454929 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.454856 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.467167 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.467135 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsz9d\" (UniqueName: \"kubernetes.io/projected/abe364ab-f3a4-42ae-acea-b97d69b3b969-kube-api-access-tsz9d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.596391 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.596307 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:30.728553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.728531 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx"] Jul 03 20:37:30.730312 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:37:30.730285 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe364ab_f3a4_42ae_acea_b97d69b3b969.slice/crio-c2a273443f4951f1dba2596c038faab7e28d9e1faafb6e337a913f3a9a8c07e9 WatchSource:0}: Error finding container c2a273443f4951f1dba2596c038faab7e28d9e1faafb6e337a913f3a9a8c07e9: Status 404 returned error can't find the container with id c2a273443f4951f1dba2596c038faab7e28d9e1faafb6e337a913f3a9a8c07e9 Jul 03 20:37:30.736575 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.736555 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vqlvj"] Jul 03 20:37:30.739315 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.739294 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:30.744439 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.744420 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-kjbb9\"" Jul 03 20:37:30.756477 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.756454 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vqlvj"] Jul 03 20:37:30.756702 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.756669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20843308-f7d7-42bb-ab5c-5efdcb31f545-bound-sa-token\") pod \"cert-manager-55b4d954d5-vqlvj\" (UID: \"20843308-f7d7-42bb-ab5c-5efdcb31f545\") " pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:30.756784 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.756772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svnrc\" (UniqueName: \"kubernetes.io/projected/20843308-f7d7-42bb-ab5c-5efdcb31f545-kube-api-access-svnrc\") pod \"cert-manager-55b4d954d5-vqlvj\" (UID: \"20843308-f7d7-42bb-ab5c-5efdcb31f545\") " pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:30.857727 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.857625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svnrc\" (UniqueName: \"kubernetes.io/projected/20843308-f7d7-42bb-ab5c-5efdcb31f545-kube-api-access-svnrc\") pod \"cert-manager-55b4d954d5-vqlvj\" (UID: \"20843308-f7d7-42bb-ab5c-5efdcb31f545\") " pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:30.857727 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.857705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20843308-f7d7-42bb-ab5c-5efdcb31f545-bound-sa-token\") pod \"cert-manager-55b4d954d5-vqlvj\" (UID: \"20843308-f7d7-42bb-ab5c-5efdcb31f545\") " pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:30.866977 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.866952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20843308-f7d7-42bb-ab5c-5efdcb31f545-bound-sa-token\") pod \"cert-manager-55b4d954d5-vqlvj\" (UID: \"20843308-f7d7-42bb-ab5c-5efdcb31f545\") " pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:30.867140 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:30.867122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svnrc\" (UniqueName: \"kubernetes.io/projected/20843308-f7d7-42bb-ab5c-5efdcb31f545-kube-api-access-svnrc\") pod \"cert-manager-55b4d954d5-vqlvj\" (UID: \"20843308-f7d7-42bb-ab5c-5efdcb31f545\") " pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:31.070826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.070791 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vqlvj" Jul 03 20:37:31.198457 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.198331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vqlvj"] Jul 03 20:37:31.200479 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:37:31.200457 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20843308_f7d7_42bb_ab5c_5efdcb31f545.slice/crio-695a563124f4660c9533b1931fd178826268280bd96446596c38149bb605cb31 WatchSource:0}: Error finding container 695a563124f4660c9533b1931fd178826268280bd96446596c38149bb605cb31: Status 404 returned error can't find the container with id 695a563124f4660c9533b1931fd178826268280bd96446596c38149bb605cb31 Jul 03 20:37:31.402482 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.402389 2578 generic.go:356] "Generic (PLEG): container finished" podID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerID="0201b59ab802151944c4fe7c7b0015a15ff4f83406368ec965c87297ac97203d" exitCode=0 Jul 03 20:37:31.402933 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.402475 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" event={"ID":"abe364ab-f3a4-42ae-acea-b97d69b3b969","Type":"ContainerDied","Data":"0201b59ab802151944c4fe7c7b0015a15ff4f83406368ec965c87297ac97203d"} Jul 03 20:37:31.402933 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.402527 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" event={"ID":"abe364ab-f3a4-42ae-acea-b97d69b3b969","Type":"ContainerStarted","Data":"c2a273443f4951f1dba2596c038faab7e28d9e1faafb6e337a913f3a9a8c07e9"} Jul 03 20:37:31.403104 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.403089 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 20:37:31.404087 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.404064 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vqlvj" event={"ID":"20843308-f7d7-42bb-ab5c-5efdcb31f545","Type":"ContainerStarted","Data":"efe7cc2ac0b1136429c701b037aaf0830dc84f60af4fcacb1cdc19ac2f1ebadf"} Jul 03 20:37:31.404179 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.404096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vqlvj" event={"ID":"20843308-f7d7-42bb-ab5c-5efdcb31f545","Type":"ContainerStarted","Data":"695a563124f4660c9533b1931fd178826268280bd96446596c38149bb605cb31"} Jul 03 20:37:31.440074 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:31.440027 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vqlvj" podStartSLOduration=1.440014194 podStartE2EDuration="1.440014194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:31.438129183 +0000 UTC m=+308.346990624" watchObservedRunningTime="2026-07-03 20:37:31.440014194 +0000 UTC m=+308.348875636" Jul 03 20:37:32.410480 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:32.410445 2578 generic.go:356] "Generic (PLEG): container finished" podID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerID="5324fab8dc972c02862898919dd127411c6b734df386c2122fd4e707cfb94336" exitCode=0 Jul 03 20:37:32.410913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:32.410532 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" event={"ID":"abe364ab-f3a4-42ae-acea-b97d69b3b969","Type":"ContainerDied","Data":"5324fab8dc972c02862898919dd127411c6b734df386c2122fd4e707cfb94336"} Jul 03 20:37:33.417569 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:33.417535 2578 generic.go:356] "Generic (PLEG): container finished" podID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerID="2ea45bb67ba141cf381f429adc3a37ba6f333d7c64ef2e88105071c381eb1680" exitCode=0 Jul 03 20:37:33.417976 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:33.417601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" event={"ID":"abe364ab-f3a4-42ae-acea-b97d69b3b969","Type":"ContainerDied","Data":"2ea45bb67ba141cf381f429adc3a37ba6f333d7c64ef2e88105071c381eb1680"} Jul 03 20:37:34.549442 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.549421 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:34.581366 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.581340 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsz9d\" (UniqueName: \"kubernetes.io/projected/abe364ab-f3a4-42ae-acea-b97d69b3b969-kube-api-access-tsz9d\") pod \"abe364ab-f3a4-42ae-acea-b97d69b3b969\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " Jul 03 20:37:34.581547 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.581373 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-util\") pod \"abe364ab-f3a4-42ae-acea-b97d69b3b969\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " Jul 03 20:37:34.581547 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.581417 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-bundle\") pod \"abe364ab-f3a4-42ae-acea-b97d69b3b969\" (UID: \"abe364ab-f3a4-42ae-acea-b97d69b3b969\") " Jul 03 20:37:34.582176 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.582150 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-bundle" (OuterVolumeSpecName: "bundle") pod "abe364ab-f3a4-42ae-acea-b97d69b3b969" (UID: "abe364ab-f3a4-42ae-acea-b97d69b3b969"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:37:34.583434 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.583408 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe364ab-f3a4-42ae-acea-b97d69b3b969-kube-api-access-tsz9d" (OuterVolumeSpecName: "kube-api-access-tsz9d") pod "abe364ab-f3a4-42ae-acea-b97d69b3b969" (UID: "abe364ab-f3a4-42ae-acea-b97d69b3b969"). InnerVolumeSpecName "kube-api-access-tsz9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:37:34.587179 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.587143 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-util" (OuterVolumeSpecName: "util") pod "abe364ab-f3a4-42ae-acea-b97d69b3b969" (UID: "abe364ab-f3a4-42ae-acea-b97d69b3b969"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:37:34.682486 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.682456 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsz9d\" (UniqueName: \"kubernetes.io/projected/abe364ab-f3a4-42ae-acea-b97d69b3b969-kube-api-access-tsz9d\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:37:34.682486 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.682485 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-util\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:37:34.682663 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:34.682494 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/abe364ab-f3a4-42ae-acea-b97d69b3b969-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:37:35.428297 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:35.428263 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" event={"ID":"abe364ab-f3a4-42ae-acea-b97d69b3b969","Type":"ContainerDied","Data":"c2a273443f4951f1dba2596c038faab7e28d9e1faafb6e337a913f3a9a8c07e9"} Jul 03 20:37:35.428297 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:35.428281 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwlwlx" Jul 03 20:37:35.428498 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:35.428311 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2a273443f4951f1dba2596c038faab7e28d9e1faafb6e337a913f3a9a8c07e9" Jul 03 20:37:44.604242 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:44.604200 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:44.699207 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:44.699177 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:45.210111 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.210082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:45.426780 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.426747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:45.525562 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.525481 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:45.632561 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.632529 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt"] Jul 03 20:37:45.633045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.632907 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerName="util" Jul 03 20:37:45.633045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.632920 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerName="util" Jul 03 20:37:45.633045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.632932 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerName="pull" Jul 03 20:37:45.633045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.632937 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerName="pull" Jul 03 20:37:45.633045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.632949 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerName="extract" Jul 03 20:37:45.633045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.632954 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerName="extract" Jul 03 20:37:45.633045 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.633021 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe364ab-f3a4-42ae-acea-b97d69b3b969" containerName="extract" Jul 03 20:37:45.635959 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.635939 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt"] Jul 03 20:37:45.636088 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.636046 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.639717 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.639680 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 03 20:37:45.640093 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.640076 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 03 20:37:45.640184 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.640074 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 03 20:37:45.640237 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.640204 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p699g\"" Jul 03 20:37:45.641431 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.641412 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 03 20:37:45.674198 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.674167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-tmp\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.674326 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.674220 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4zpz\" (UniqueName: \"kubernetes.io/projected/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-kube-api-access-c4zpz\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.674366 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.674318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-webhook-cert\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.674366 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.674354 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.674451 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.674376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-manifests\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.775169 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.775133 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-manifests\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.775363 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.775183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-tmp\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.775363 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.775230 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4zpz\" (UniqueName: \"kubernetes.io/projected/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-kube-api-access-c4zpz\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.775363 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.775261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-webhook-cert\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.775363 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.775281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.775634 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.775580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-manifests\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.777459 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.777428 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-tmp\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.777676 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.777655 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-webhook-cert\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.777838 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.777806 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.783154 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.783130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:45.784050 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.784028 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4zpz\" (UniqueName: \"kubernetes.io/projected/ecc906da-0b09-4e21-8f2d-b8eb47af8eed-kube-api-access-c4zpz\") pod \"opendatahub-operator-controller-manager-8554cfd646-pqhbt\" (UID: \"ecc906da-0b09-4e21-8f2d-b8eb47af8eed\") " pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.883898 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.883865 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:45.947051 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.947019 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:45.983955 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:45.983924 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:46.054951 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:46.054922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:46.081155 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:46.081133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt"] Jul 03 20:37:46.082993 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:37:46.082966 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc906da_0b09_4e21_8f2d_b8eb47af8eed.slice/crio-cb354d9b49dc4a186c44ab06182ffa1d65bb273c8a9518572d60129fbc78ad52 WatchSource:0}: Error finding container cb354d9b49dc4a186c44ab06182ffa1d65bb273c8a9518572d60129fbc78ad52: Status 404 returned error can't find the container with id cb354d9b49dc4a186c44ab06182ffa1d65bb273c8a9518572d60129fbc78ad52 Jul 03 20:37:46.115946 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:46.115922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:46.213132 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:46.213103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:46.316122 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:46.316047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:37:46.481625 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:46.481595 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" event={"ID":"ecc906da-0b09-4e21-8f2d-b8eb47af8eed","Type":"ContainerStarted","Data":"cb354d9b49dc4a186c44ab06182ffa1d65bb273c8a9518572d60129fbc78ad52"} Jul 03 20:37:49.500089 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:49.500055 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" event={"ID":"ecc906da-0b09-4e21-8f2d-b8eb47af8eed","Type":"ContainerStarted","Data":"324893a4ca56c2ba63ce3562b4318177cc6c17c4385eda91484216d547d6b2e2"} Jul 03 20:37:50.506757 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:50.506721 2578 generic.go:356] "Generic (PLEG): container finished" podID="ecc906da-0b09-4e21-8f2d-b8eb47af8eed" containerID="324893a4ca56c2ba63ce3562b4318177cc6c17c4385eda91484216d547d6b2e2" exitCode=0 Jul 03 20:37:50.507163 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:50.506807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" event={"ID":"ecc906da-0b09-4e21-8f2d-b8eb47af8eed","Type":"ContainerDied","Data":"324893a4ca56c2ba63ce3562b4318177cc6c17c4385eda91484216d547d6b2e2"} Jul 03 20:37:51.513162 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:51.513136 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" event={"ID":"ecc906da-0b09-4e21-8f2d-b8eb47af8eed","Type":"ContainerStarted","Data":"5a97635f3e1521856cc60a4f63c863cc6f59aec88b624e5a6ce74d1cc2822f8d"} Jul 03 20:37:51.513562 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:51.513362 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:37:51.536787 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:37:51.536745 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" podStartSLOduration=2.181986815 podStartE2EDuration="6.536729903s" totalImagesPullingTime="3.259998716s" totalInitContainerRuntime="1.094744372s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:37:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:37:51.535322894 +0000 UTC m=+328.444184337" watchObservedRunningTime="2026-07-03 20:37:51.536729903 +0000 UTC m=+328.445591344" Jul 03 20:38:02.520017 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:02.519977 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8554cfd646-pqhbt" Jul 03 20:38:02.737646 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:02.737588 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:02.984031 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:02.984003 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:02.998313 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:02.998291 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2"] Jul 03 20:38:03.007296 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.007276 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.015154 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.015135 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 03 20:38:03.015582 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.015554 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 03 20:38:03.015582 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.015552 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 03 20:38:03.015745 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.015601 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-27tqw\"" Jul 03 20:38:03.015970 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.015949 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2"] Jul 03 20:38:03.122646 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.122608 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d66d550-e256-489e-a1a8-59bc0baf6df8-metrics-cert\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.122849 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.122674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0d66d550-e256-489e-a1a8-59bc0baf6df8-manager-config\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.122849 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.122728 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d66d550-e256-489e-a1a8-59bc0baf6df8-cert\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.122849 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.122809 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvkf\" (UniqueName: \"kubernetes.io/projected/0d66d550-e256-489e-a1a8-59bc0baf6df8-kube-api-access-4qvkf\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.224067 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.224039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d66d550-e256-489e-a1a8-59bc0baf6df8-cert\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.224216 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.224084 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvkf\" (UniqueName: \"kubernetes.io/projected/0d66d550-e256-489e-a1a8-59bc0baf6df8-kube-api-access-4qvkf\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.224216 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.224102 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d66d550-e256-489e-a1a8-59bc0baf6df8-metrics-cert\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.224216 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.224148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0d66d550-e256-489e-a1a8-59bc0baf6df8-manager-config\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.224896 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.224871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0d66d550-e256-489e-a1a8-59bc0baf6df8-manager-config\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.226447 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.226426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d66d550-e256-489e-a1a8-59bc0baf6df8-cert\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.226546 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.226492 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0d66d550-e256-489e-a1a8-59bc0baf6df8-metrics-cert\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.243829 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.243771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvkf\" (UniqueName: \"kubernetes.io/projected/0d66d550-e256-489e-a1a8-59bc0baf6df8-kube-api-access-4qvkf\") pod \"lws-controller-manager-66fb5847b8-444b2\" (UID: \"0d66d550-e256-489e-a1a8-59bc0baf6df8\") " pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.317247 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.317211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:03.467396 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.467374 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2"] Jul 03 20:38:03.469671 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:38:03.469649 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d66d550_e256_489e_a1a8_59bc0baf6df8.slice/crio-7be0719d5f3f873544e4ad9b9723464b990242cd46d48b012f85739843259756 WatchSource:0}: Error finding container 7be0719d5f3f873544e4ad9b9723464b990242cd46d48b012f85739843259756: Status 404 returned error can't find the container with id 7be0719d5f3f873544e4ad9b9723464b990242cd46d48b012f85739843259756 Jul 03 20:38:03.568809 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:03.568734 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" event={"ID":"0d66d550-e256-489e-a1a8-59bc0baf6df8","Type":"ContainerStarted","Data":"7be0719d5f3f873544e4ad9b9723464b990242cd46d48b012f85739843259756"} Jul 03 20:38:04.855519 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:04.855480 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:05.078292 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:05.078262 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:05.304834 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:05.304795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:05.581407 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:05.581306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" event={"ID":"0d66d550-e256-489e-a1a8-59bc0baf6df8","Type":"ContainerStarted","Data":"6b2752b924fb0cf4e66381d379151ef03f098a734d2ca29a2815a8d67b4062d7"} Jul 03 20:38:05.581569 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:05.581427 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:05.633481 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:05.633430 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" podStartSLOduration=2.15444642 podStartE2EDuration="3.633413659s" totalImagesPullingTime="1.478967239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:38:05.631598008 +0000 UTC m=+342.540459459" watchObservedRunningTime="2026-07-03 20:38:05.633413659 +0000 UTC m=+342.542275101" Jul 03 20:38:05.671902 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:05.671874 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:06.098639 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:06.098606 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:06.289479 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:06.289445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:06.515200 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:06.515167 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:07.792862 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:07.792828 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:08.005119 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:08.005083 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:08.473968 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:08.473935 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:08.662838 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:08.662808 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:10.112391 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:10.112361 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:13.483200 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:13.483164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:13.585746 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:13.585713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:14.426563 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.426534 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl"] Jul 03 20:38:14.430161 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.430127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.432980 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.432959 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 03 20:38:14.433541 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.433516 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z2jp8\"" Jul 03 20:38:14.433815 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.433796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 03 20:38:14.433948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.433888 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 03 20:38:14.448584 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.448557 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl"] Jul 03 20:38:14.480469 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.480429 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:14.531271 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531237 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531294 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531339 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531371 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnp45\" (UniqueName: \"kubernetes.io/projected/0c8fa598-c6a4-48f1-8828-e31c4674cb91-kube-api-access-lnp45\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531498 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.531645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.531578 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632128 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632128 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632131 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632392 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632153 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632392 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnp45\" (UniqueName: \"kubernetes.io/projected/0c8fa598-c6a4-48f1-8828-e31c4674cb91-kube-api-access-lnp45\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632509 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632509 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632549 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632623 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632831 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.632957 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.632923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.633130 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.633109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.633400 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.633377 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.635015 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.634984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.635206 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.635189 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.646252 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.646226 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c8fa598-c6a4-48f1-8828-e31c4674cb91-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.646729 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.646712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnp45\" (UniqueName: \"kubernetes.io/projected/0c8fa598-c6a4-48f1-8828-e31c4674cb91-kube-api-access-lnp45\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xd6bl\" (UID: \"0c8fa598-c6a4-48f1-8828-e31c4674cb91\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.659673 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.659651 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw"] Jul 03 20:38:14.663937 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.663922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.668155 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.668138 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 03 20:38:14.668352 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.668335 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 03 20:38:14.668444 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.668426 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dxmcx\"" Jul 03 20:38:14.668751 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.668737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 03 20:38:14.697570 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.697498 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw"] Jul 03 20:38:14.742609 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.742579 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:14.811675 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.811649 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:14.835219 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.835193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.835363 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.835253 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.835428 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.835404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.835500 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.835475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.835552 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.835517 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1edc714-b9dc-43dc-9477-05dbaccfcdef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.835552 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.835547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkrwh\" (UniqueName: \"kubernetes.io/projected/b1edc714-b9dc-43dc-9477-05dbaccfcdef-kube-api-access-pkrwh\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.835666 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.835581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.877456 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.877433 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl"] Jul 03 20:38:14.879757 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:38:14.879731 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8fa598_c6a4_48f1_8828_e31c4674cb91.slice/crio-feb0dd6bf0e695088f7ce6256b7bbae551bb217e74b3ea55109f532ab5817e93 WatchSource:0}: Error finding container feb0dd6bf0e695088f7ce6256b7bbae551bb217e74b3ea55109f532ab5817e93: Status 404 returned error can't find the container with id feb0dd6bf0e695088f7ce6256b7bbae551bb217e74b3ea55109f532ab5817e93 Jul 03 20:38:14.936437 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.936411 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.936552 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.936442 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1edc714-b9dc-43dc-9477-05dbaccfcdef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.936552 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.936464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkrwh\" (UniqueName: \"kubernetes.io/projected/b1edc714-b9dc-43dc-9477-05dbaccfcdef-kube-api-access-pkrwh\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.936552 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.936496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.936552 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.936529 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.936743 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.936665 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.936808 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.936787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.937570 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.937545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.938700 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.938665 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1edc714-b9dc-43dc-9477-05dbaccfcdef-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.938911 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.938895 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.938958 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.938906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.938958 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.938898 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.944751 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.944735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1edc714-b9dc-43dc-9477-05dbaccfcdef-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.944966 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.944951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkrwh\" (UniqueName: \"kubernetes.io/projected/b1edc714-b9dc-43dc-9477-05dbaccfcdef-kube-api-access-pkrwh\") pod \"istiod-openshift-gateway-94bb8fbfd-d9mlw\" (UID: \"b1edc714-b9dc-43dc-9477-05dbaccfcdef\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:14.972944 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:14.972898 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:15.107354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:15.107331 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw"] Jul 03 20:38:15.109184 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:38:15.109161 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1edc714_b9dc_43dc_9477_05dbaccfcdef.slice/crio-86910b22f3af52f82ae413b62540e446b1d234b638de18380d3caea55dc317bc WatchSource:0}: Error finding container 86910b22f3af52f82ae413b62540e446b1d234b638de18380d3caea55dc317bc: Status 404 returned error can't find the container with id 86910b22f3af52f82ae413b62540e446b1d234b638de18380d3caea55dc317bc Jul 03 20:38:15.641741 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:15.641708 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" event={"ID":"0c8fa598-c6a4-48f1-8828-e31c4674cb91","Type":"ContainerStarted","Data":"feb0dd6bf0e695088f7ce6256b7bbae551bb217e74b3ea55109f532ab5817e93"} Jul 03 20:38:15.642927 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:15.642901 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" event={"ID":"b1edc714-b9dc-43dc-9477-05dbaccfcdef","Type":"ContainerStarted","Data":"86910b22f3af52f82ae413b62540e446b1d234b638de18380d3caea55dc317bc"} Jul 03 20:38:16.590815 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:16.590787 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66fb5847b8-444b2" Jul 03 20:38:17.501435 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:17.501370 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:17.619675 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:17.618533 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:17.752332 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:17.752218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:17.851037 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:17.850942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:17.983211 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:17.983178 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:38:18.723760 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:18.723719 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:38:18.724118 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:18.723797 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:38:19.673493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:19.673455 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" event={"ID":"b1edc714-b9dc-43dc-9477-05dbaccfcdef","Type":"ContainerStarted","Data":"12e0055b38e582365786cf8bca77607de31bac20c649dfc9fd0c53c6b5576231"} Jul 03 20:38:19.673792 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:19.673734 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:19.675526 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:19.675500 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" Jul 03 20:38:19.702604 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:19.702554 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-d9mlw" podStartSLOduration=2.090350646 podStartE2EDuration="5.702538807s" totalImagesPullingTime="3.612188161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:38:19.70187558 +0000 UTC m=+356.610737022" watchObservedRunningTime="2026-07-03 20:38:19.702538807 +0000 UTC m=+356.611400226" Jul 03 20:38:28.186233 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:28.186195 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:38:28.186489 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:28.186267 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:38:28.186489 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:28.186299 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:38:28.725890 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:28.725855 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" event={"ID":"0c8fa598-c6a4-48f1-8828-e31c4674cb91","Type":"ContainerStarted","Data":"50db8b7aee95a3f659e700ce5b285cf1dc24763e5f6571c827a3ba8ec3416777"} Jul 03 20:38:28.743487 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:28.743455 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:28.746836 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:28.746774 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" podStartSLOduration=1.44250301 podStartE2EDuration="14.746758398s" totalImagesPullingTime="13.304255388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:38:28.745236007 +0000 UTC m=+365.654097463" watchObservedRunningTime="2026-07-03 20:38:28.746758398 +0000 UTC m=+365.655619840" Jul 03 20:38:29.742936 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:29.742911 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:29.747270 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:29.747249 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:38:30.736978 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:38:30.736949 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xd6bl" Jul 03 20:39:06.537299 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:06.537263 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:06.745382 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:06.745344 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:06.950359 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:06.950329 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:22.062842 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.062805 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf"] Jul 03 20:39:22.066384 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.066367 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.068880 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.068859 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 03 20:39:22.069011 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.068895 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 03 20:39:22.069864 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.069840 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-q6cg7\"" Jul 03 20:39:22.074010 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.073987 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf"] Jul 03 20:39:22.130009 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.129975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.130192 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.130021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r7pr\" (UniqueName: \"kubernetes.io/projected/0d15749a-0983-489e-8a31-1ce19e064630-kube-api-access-2r7pr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.130192 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.130049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.230522 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.230486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.230720 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.230534 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r7pr\" (UniqueName: \"kubernetes.io/projected/0d15749a-0983-489e-8a31-1ce19e064630-kube-api-access-2r7pr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.230720 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.230558 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.230917 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.230899 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.230956 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.230914 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.239388 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.239365 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r7pr\" (UniqueName: \"kubernetes.io/projected/0d15749a-0983-489e-8a31-1ce19e064630-kube-api-access-2r7pr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.375606 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.375520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:22.506288 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.506265 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf"] Jul 03 20:39:22.508031 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:39:22.508006 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d15749a_0983_489e_8a31_1ce19e064630.slice/crio-81d0856ee0c9bbd9dc9525a3ac7019fbd01af5004d60f5017624f6efd241a4b9 WatchSource:0}: Error finding container 81d0856ee0c9bbd9dc9525a3ac7019fbd01af5004d60f5017624f6efd241a4b9: Status 404 returned error can't find the container with id 81d0856ee0c9bbd9dc9525a3ac7019fbd01af5004d60f5017624f6efd241a4b9 Jul 03 20:39:22.661913 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.661842 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg"] Jul 03 20:39:22.665379 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.665364 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.673351 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.673325 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg"] Jul 03 20:39:22.735478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.735443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.735647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.735501 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.735647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.735528 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp6jc\" (UniqueName: \"kubernetes.io/projected/8fd2937b-d9f0-4911-8ddf-5980058aba76-kube-api-access-hp6jc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.836135 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.836099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.836135 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.836139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.836398 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.836162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp6jc\" (UniqueName: \"kubernetes.io/projected/8fd2937b-d9f0-4911-8ddf-5980058aba76-kube-api-access-hp6jc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.836551 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.836530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.836619 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.836550 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.845201 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.845173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp6jc\" (UniqueName: \"kubernetes.io/projected/8fd2937b-d9f0-4911-8ddf-5980058aba76-kube-api-access-hp6jc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.975098 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.975062 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:22.995334 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.995307 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d15749a-0983-489e-8a31-1ce19e064630" containerID="8bcd999da5e9f6fdfdb722a4d60db2a07777af2aa5267763df55de8ff86d0e3a" exitCode=0 Jul 03 20:39:22.995479 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.995382 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" event={"ID":"0d15749a-0983-489e-8a31-1ce19e064630","Type":"ContainerDied","Data":"8bcd999da5e9f6fdfdb722a4d60db2a07777af2aa5267763df55de8ff86d0e3a"} Jul 03 20:39:22.995479 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:22.995427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" event={"ID":"0d15749a-0983-489e-8a31-1ce19e064630","Type":"ContainerStarted","Data":"81d0856ee0c9bbd9dc9525a3ac7019fbd01af5004d60f5017624f6efd241a4b9"} Jul 03 20:39:23.065704 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.065660 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7"] Jul 03 20:39:23.071156 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.071122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.077802 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.077772 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7"] Jul 03 20:39:23.112973 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.112948 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg"] Jul 03 20:39:23.114985 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:39:23.114952 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd2937b_d9f0_4911_8ddf_5980058aba76.slice/crio-f3a63ab242cbc07dfb2d182e794130f47e82779089ca18e2df67606dc4ec1ebe WatchSource:0}: Error finding container f3a63ab242cbc07dfb2d182e794130f47e82779089ca18e2df67606dc4ec1ebe: Status 404 returned error can't find the container with id f3a63ab242cbc07dfb2d182e794130f47e82779089ca18e2df67606dc4ec1ebe Jul 03 20:39:23.138987 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.138963 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.139072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.139003 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.139117 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.139101 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt8zm\" (UniqueName: \"kubernetes.io/projected/81e79f8f-23ae-4a07-8526-691076a6d867-kube-api-access-dt8zm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.240096 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.240010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt8zm\" (UniqueName: \"kubernetes.io/projected/81e79f8f-23ae-4a07-8526-691076a6d867-kube-api-access-dt8zm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.240096 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.240074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.240320 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.240117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.240554 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.240532 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.240609 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.240594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.248555 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.248528 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt8zm\" (UniqueName: \"kubernetes.io/projected/81e79f8f-23ae-4a07-8526-691076a6d867-kube-api-access-dt8zm\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.385000 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.384964 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:23.466326 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.466291 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w"] Jul 03 20:39:23.470338 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.470313 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.481136 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.480096 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w"] Jul 03 20:39:23.524668 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.524641 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7"] Jul 03 20:39:23.526331 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:39:23.526299 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e79f8f_23ae_4a07_8526_691076a6d867.slice/crio-dd5aa858c7ddaa3026d03e2ad825d2ae0661044017bdb0c2cc0f3371945c3c85 WatchSource:0}: Error finding container dd5aa858c7ddaa3026d03e2ad825d2ae0661044017bdb0c2cc0f3371945c3c85: Status 404 returned error can't find the container with id dd5aa858c7ddaa3026d03e2ad825d2ae0661044017bdb0c2cc0f3371945c3c85 Jul 03 20:39:23.544155 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.544124 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqhbn\" (UniqueName: \"kubernetes.io/projected/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-kube-api-access-bqhbn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.544266 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.544191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.544266 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.544256 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.645113 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.645087 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqhbn\" (UniqueName: \"kubernetes.io/projected/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-kube-api-access-bqhbn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.645202 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.645139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.645202 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.645177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.645481 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.645463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.645525 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.645509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.657267 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.657242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqhbn\" (UniqueName: \"kubernetes.io/projected/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-kube-api-access-bqhbn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.783675 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.783590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:23.915072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:23.915048 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w"] Jul 03 20:39:23.916484 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:39:23.916460 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebc9dc4_384d_411a_97d2_52ec4353e8c1.slice/crio-483ed3aa7a94ef782be1c75c9c67e102cf940134f8e7e3daa490c26c1516b1bd WatchSource:0}: Error finding container 483ed3aa7a94ef782be1c75c9c67e102cf940134f8e7e3daa490c26c1516b1bd: Status 404 returned error can't find the container with id 483ed3aa7a94ef782be1c75c9c67e102cf940134f8e7e3daa490c26c1516b1bd Jul 03 20:39:24.003040 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.003010 2578 generic.go:356] "Generic (PLEG): container finished" podID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerID="5170d2991ce2fd8219a24bb3bae500d686cb03708dcf37761bd9b963093abbfc" exitCode=0 Jul 03 20:39:24.003217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.003070 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" event={"ID":"8fd2937b-d9f0-4911-8ddf-5980058aba76","Type":"ContainerDied","Data":"5170d2991ce2fd8219a24bb3bae500d686cb03708dcf37761bd9b963093abbfc"} Jul 03 20:39:24.003217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.003122 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" event={"ID":"8fd2937b-d9f0-4911-8ddf-5980058aba76","Type":"ContainerStarted","Data":"f3a63ab242cbc07dfb2d182e794130f47e82779089ca18e2df67606dc4ec1ebe"} Jul 03 20:39:24.004925 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.004887 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" event={"ID":"3ebc9dc4-384d-411a-97d2-52ec4353e8c1","Type":"ContainerStarted","Data":"08327c39630b9b8df7eebed248857a1ba16b3771ccf267384d70348070b94b22"} Jul 03 20:39:24.005028 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.004952 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" event={"ID":"3ebc9dc4-384d-411a-97d2-52ec4353e8c1","Type":"ContainerStarted","Data":"483ed3aa7a94ef782be1c75c9c67e102cf940134f8e7e3daa490c26c1516b1bd"} Jul 03 20:39:24.006500 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.006473 2578 generic.go:356] "Generic (PLEG): container finished" podID="81e79f8f-23ae-4a07-8526-691076a6d867" containerID="6c5d80640b4b565b8867476222939d32166fc0aa67254b558de7505218b6d346" exitCode=0 Jul 03 20:39:24.006660 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.006560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" event={"ID":"81e79f8f-23ae-4a07-8526-691076a6d867","Type":"ContainerDied","Data":"6c5d80640b4b565b8867476222939d32166fc0aa67254b558de7505218b6d346"} Jul 03 20:39:24.006660 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.006601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" event={"ID":"81e79f8f-23ae-4a07-8526-691076a6d867","Type":"ContainerStarted","Data":"dd5aa858c7ddaa3026d03e2ad825d2ae0661044017bdb0c2cc0f3371945c3c85"} Jul 03 20:39:24.008949 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.008930 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d15749a-0983-489e-8a31-1ce19e064630" containerID="09bb5484f31a83af01e1d7b329987ab43bef6f578f4be0d21b406060fcee08d1" exitCode=0 Jul 03 20:39:24.009055 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:24.009031 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" event={"ID":"0d15749a-0983-489e-8a31-1ce19e064630","Type":"ContainerDied","Data":"09bb5484f31a83af01e1d7b329987ab43bef6f578f4be0d21b406060fcee08d1"} Jul 03 20:39:25.015305 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.015272 2578 generic.go:356] "Generic (PLEG): container finished" podID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerID="ff2972eaf797cd80cf43f806f1300061e50d331de5711109d31b4fd279851213" exitCode=0 Jul 03 20:39:25.015773 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.015339 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" event={"ID":"8fd2937b-d9f0-4911-8ddf-5980058aba76","Type":"ContainerDied","Data":"ff2972eaf797cd80cf43f806f1300061e50d331de5711109d31b4fd279851213"} Jul 03 20:39:25.016960 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.016829 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerID="08327c39630b9b8df7eebed248857a1ba16b3771ccf267384d70348070b94b22" exitCode=0 Jul 03 20:39:25.016960 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.016875 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" event={"ID":"3ebc9dc4-384d-411a-97d2-52ec4353e8c1","Type":"ContainerDied","Data":"08327c39630b9b8df7eebed248857a1ba16b3771ccf267384d70348070b94b22"} Jul 03 20:39:25.018889 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.018865 2578 generic.go:356] "Generic (PLEG): container finished" podID="81e79f8f-23ae-4a07-8526-691076a6d867" containerID="1f0615f7267637bda9fc90693723489b87258cd972671c5d40db70d0b41f7efd" exitCode=0 Jul 03 20:39:25.019001 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.018947 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" event={"ID":"81e79f8f-23ae-4a07-8526-691076a6d867","Type":"ContainerDied","Data":"1f0615f7267637bda9fc90693723489b87258cd972671c5d40db70d0b41f7efd"} Jul 03 20:39:25.022023 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.021997 2578 generic.go:356] "Generic (PLEG): container finished" podID="0d15749a-0983-489e-8a31-1ce19e064630" containerID="dc4419fed48a3bfa1855e743b985d4fb20e654a250e7643c5ec605bf2170c3ad" exitCode=0 Jul 03 20:39:25.022151 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:25.022137 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" event={"ID":"0d15749a-0983-489e-8a31-1ce19e064630","Type":"ContainerDied","Data":"dc4419fed48a3bfa1855e743b985d4fb20e654a250e7643c5ec605bf2170c3ad"} Jul 03 20:39:26.032507 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.032475 2578 generic.go:356] "Generic (PLEG): container finished" podID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerID="e37c77cadb2a25d89f648a95caa0635e24831630e7959def14eda8efba173b2d" exitCode=0 Jul 03 20:39:26.032971 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.032541 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" event={"ID":"8fd2937b-d9f0-4911-8ddf-5980058aba76","Type":"ContainerDied","Data":"e37c77cadb2a25d89f648a95caa0635e24831630e7959def14eda8efba173b2d"} Jul 03 20:39:26.034454 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.034434 2578 generic.go:356] "Generic (PLEG): container finished" podID="81e79f8f-23ae-4a07-8526-691076a6d867" containerID="a7ac5124d1b86ec93e17c690a5a95e6fbfe43d9f93e8dc8739369acad4246451" exitCode=0 Jul 03 20:39:26.034556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.034498 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" event={"ID":"81e79f8f-23ae-4a07-8526-691076a6d867","Type":"ContainerDied","Data":"a7ac5124d1b86ec93e17c690a5a95e6fbfe43d9f93e8dc8739369acad4246451"} Jul 03 20:39:26.231370 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.231345 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:26.271138 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.271107 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-util\") pod \"0d15749a-0983-489e-8a31-1ce19e064630\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " Jul 03 20:39:26.271282 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.271168 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r7pr\" (UniqueName: \"kubernetes.io/projected/0d15749a-0983-489e-8a31-1ce19e064630-kube-api-access-2r7pr\") pod \"0d15749a-0983-489e-8a31-1ce19e064630\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " Jul 03 20:39:26.271282 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.271213 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-bundle\") pod \"0d15749a-0983-489e-8a31-1ce19e064630\" (UID: \"0d15749a-0983-489e-8a31-1ce19e064630\") " Jul 03 20:39:26.271736 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.271710 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-bundle" (OuterVolumeSpecName: "bundle") pod "0d15749a-0983-489e-8a31-1ce19e064630" (UID: "0d15749a-0983-489e-8a31-1ce19e064630"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:26.273415 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.273387 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d15749a-0983-489e-8a31-1ce19e064630-kube-api-access-2r7pr" (OuterVolumeSpecName: "kube-api-access-2r7pr") pod "0d15749a-0983-489e-8a31-1ce19e064630" (UID: "0d15749a-0983-489e-8a31-1ce19e064630"). InnerVolumeSpecName "kube-api-access-2r7pr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:39:26.277128 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.277087 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-util" (OuterVolumeSpecName: "util") pod "0d15749a-0983-489e-8a31-1ce19e064630" (UID: "0d15749a-0983-489e-8a31-1ce19e064630"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:26.372541 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.372444 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-util\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:26.372541 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.372485 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r7pr\" (UniqueName: \"kubernetes.io/projected/0d15749a-0983-489e-8a31-1ce19e064630-kube-api-access-2r7pr\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:26.372541 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:26.372498 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d15749a-0983-489e-8a31-1ce19e064630-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:27.041489 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.041407 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" Jul 03 20:39:27.041489 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.041438 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf" event={"ID":"0d15749a-0983-489e-8a31-1ce19e064630","Type":"ContainerDied","Data":"81d0856ee0c9bbd9dc9525a3ac7019fbd01af5004d60f5017624f6efd241a4b9"} Jul 03 20:39:27.041489 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.041482 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81d0856ee0c9bbd9dc9525a3ac7019fbd01af5004d60f5017624f6efd241a4b9" Jul 03 20:39:27.043227 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.043199 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerID="1feeb33ff8ffef72e6144fb29ca78e042ecd209f596ba1feff66f5548fd3b0a7" exitCode=0 Jul 03 20:39:27.043345 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.043255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" event={"ID":"3ebc9dc4-384d-411a-97d2-52ec4353e8c1","Type":"ContainerDied","Data":"1feeb33ff8ffef72e6144fb29ca78e042ecd209f596ba1feff66f5548fd3b0a7"} Jul 03 20:39:27.190672 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.190643 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:27.281979 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.281792 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-util\") pod \"81e79f8f-23ae-4a07-8526-691076a6d867\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " Jul 03 20:39:27.282400 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.282091 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt8zm\" (UniqueName: \"kubernetes.io/projected/81e79f8f-23ae-4a07-8526-691076a6d867-kube-api-access-dt8zm\") pod \"81e79f8f-23ae-4a07-8526-691076a6d867\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " Jul 03 20:39:27.282400 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.282135 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-bundle\") pod \"81e79f8f-23ae-4a07-8526-691076a6d867\" (UID: \"81e79f8f-23ae-4a07-8526-691076a6d867\") " Jul 03 20:39:27.282400 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.282359 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:27.282948 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.282919 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-bundle" (OuterVolumeSpecName: "bundle") pod "81e79f8f-23ae-4a07-8526-691076a6d867" (UID: "81e79f8f-23ae-4a07-8526-691076a6d867"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:27.284303 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.284273 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81e79f8f-23ae-4a07-8526-691076a6d867-kube-api-access-dt8zm" (OuterVolumeSpecName: "kube-api-access-dt8zm") pod "81e79f8f-23ae-4a07-8526-691076a6d867" (UID: "81e79f8f-23ae-4a07-8526-691076a6d867"). InnerVolumeSpecName "kube-api-access-dt8zm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:39:27.288274 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.288245 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-util" (OuterVolumeSpecName: "util") pod "81e79f8f-23ae-4a07-8526-691076a6d867" (UID: "81e79f8f-23ae-4a07-8526-691076a6d867"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:27.382907 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.382816 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-bundle\") pod \"8fd2937b-d9f0-4911-8ddf-5980058aba76\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " Jul 03 20:39:27.383072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.382934 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-util\") pod \"8fd2937b-d9f0-4911-8ddf-5980058aba76\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " Jul 03 20:39:27.383072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.382977 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp6jc\" (UniqueName: \"kubernetes.io/projected/8fd2937b-d9f0-4911-8ddf-5980058aba76-kube-api-access-hp6jc\") pod \"8fd2937b-d9f0-4911-8ddf-5980058aba76\" (UID: \"8fd2937b-d9f0-4911-8ddf-5980058aba76\") " Jul 03 20:39:27.383307 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.383290 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:27.383369 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.383311 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81e79f8f-23ae-4a07-8526-691076a6d867-util\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:27.383369 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.383326 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt8zm\" (UniqueName: \"kubernetes.io/projected/81e79f8f-23ae-4a07-8526-691076a6d867-kube-api-access-dt8zm\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:27.383734 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.383708 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-bundle" (OuterVolumeSpecName: "bundle") pod "8fd2937b-d9f0-4911-8ddf-5980058aba76" (UID: "8fd2937b-d9f0-4911-8ddf-5980058aba76"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:27.385269 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.385243 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fd2937b-d9f0-4911-8ddf-5980058aba76-kube-api-access-hp6jc" (OuterVolumeSpecName: "kube-api-access-hp6jc") pod "8fd2937b-d9f0-4911-8ddf-5980058aba76" (UID: "8fd2937b-d9f0-4911-8ddf-5980058aba76"). InnerVolumeSpecName "kube-api-access-hp6jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:39:27.388478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.388452 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-util" (OuterVolumeSpecName: "util") pod "8fd2937b-d9f0-4911-8ddf-5980058aba76" (UID: "8fd2937b-d9f0-4911-8ddf-5980058aba76"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:27.484422 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.484385 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:27.484422 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.484414 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8fd2937b-d9f0-4911-8ddf-5980058aba76-util\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:27.484422 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:27.484424 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp6jc\" (UniqueName: \"kubernetes.io/projected/8fd2937b-d9f0-4911-8ddf-5980058aba76-kube-api-access-hp6jc\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:28.050952 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.050923 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" Jul 03 20:39:28.050952 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.050940 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg" event={"ID":"8fd2937b-d9f0-4911-8ddf-5980058aba76","Type":"ContainerDied","Data":"f3a63ab242cbc07dfb2d182e794130f47e82779089ca18e2df67606dc4ec1ebe"} Jul 03 20:39:28.051444 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.050997 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3a63ab242cbc07dfb2d182e794130f47e82779089ca18e2df67606dc4ec1ebe" Jul 03 20:39:28.053098 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.053074 2578 generic.go:356] "Generic (PLEG): container finished" podID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerID="92c1a59a4c2a9cf416225f1edb8222126f80e95a029bebd4ce0ca8ae4dd789ae" exitCode=0 Jul 03 20:39:28.053205 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.053150 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" event={"ID":"3ebc9dc4-384d-411a-97d2-52ec4353e8c1","Type":"ContainerDied","Data":"92c1a59a4c2a9cf416225f1edb8222126f80e95a029bebd4ce0ca8ae4dd789ae"} Jul 03 20:39:28.054974 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.054958 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" Jul 03 20:39:28.055071 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.054971 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7" event={"ID":"81e79f8f-23ae-4a07-8526-691076a6d867","Type":"ContainerDied","Data":"dd5aa858c7ddaa3026d03e2ad825d2ae0661044017bdb0c2cc0f3371945c3c85"} Jul 03 20:39:28.055071 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:28.055001 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd5aa858c7ddaa3026d03e2ad825d2ae0661044017bdb0c2cc0f3371945c3c85" Jul 03 20:39:29.207292 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.207266 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:29.301520 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.301491 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-bundle\") pod \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " Jul 03 20:39:29.301666 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.301540 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-util\") pod \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " Jul 03 20:39:29.301666 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.301614 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqhbn\" (UniqueName: \"kubernetes.io/projected/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-kube-api-access-bqhbn\") pod \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\" (UID: \"3ebc9dc4-384d-411a-97d2-52ec4353e8c1\") " Jul 03 20:39:29.301989 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.301965 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-bundle" (OuterVolumeSpecName: "bundle") pod "3ebc9dc4-384d-411a-97d2-52ec4353e8c1" (UID: "3ebc9dc4-384d-411a-97d2-52ec4353e8c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:29.303577 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.303555 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-kube-api-access-bqhbn" (OuterVolumeSpecName: "kube-api-access-bqhbn") pod "3ebc9dc4-384d-411a-97d2-52ec4353e8c1" (UID: "3ebc9dc4-384d-411a-97d2-52ec4353e8c1"). InnerVolumeSpecName "kube-api-access-bqhbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:39:29.403057 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.402975 2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:29.403057 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.403006 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqhbn\" (UniqueName: \"kubernetes.io/projected/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-kube-api-access-bqhbn\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:29.405947 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.405920 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-util" (OuterVolumeSpecName: "util") pod "3ebc9dc4-384d-411a-97d2-52ec4353e8c1" (UID: "3ebc9dc4-384d-411a-97d2-52ec4353e8c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 03 20:39:29.503411 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:29.503385 2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ebc9dc4-384d-411a-97d2-52ec4353e8c1-util\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:39:30.067420 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:30.067387 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" event={"ID":"3ebc9dc4-384d-411a-97d2-52ec4353e8c1","Type":"ContainerDied","Data":"483ed3aa7a94ef782be1c75c9c67e102cf940134f8e7e3daa490c26c1516b1bd"} Jul 03 20:39:30.067420 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:30.067416 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w" Jul 03 20:39:30.067591 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:30.067436 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="483ed3aa7a94ef782be1c75c9c67e102cf940134f8e7e3daa490c26c1516b1bd" Jul 03 20:39:35.529561 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:35.529524 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:38.920702 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:38.920650 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:39.730471 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:39.730437 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:43.367563 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:43.367517 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:43.604542 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:43.604514 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:43.694412 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:43.694362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:45.596212 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:45.596114 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:46.131767 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:46.131712 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:46.664594 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:46.664550 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:48.570647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:48.570610 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:48.670618 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:48.670593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:51.548076 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:51.548048 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:51.649631 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:51.649597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:56.932667 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:56.932631 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:56.987263 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:56.987234 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:57.364790 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:57.364681 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:57.457085 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:57.457050 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:58.582201 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:58.582166 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:39:58.837296 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:39:58.837225 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:00.734885 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:00.734850 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:00.840306 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:00.840270 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:03.286443 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.286406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:03.384352 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.384315 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:03.744056 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744022 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8b6445-78jwg"] Jul 03 20:40:03.744472 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744456 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerName="util" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744475 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerName="util" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744489 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e79f8f-23ae-4a07-8526-691076a6d867" containerName="util" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744498 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e79f8f-23ae-4a07-8526-691076a6d867" containerName="util" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744508 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerName="extract" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744516 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerName="extract" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744525 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e79f8f-23ae-4a07-8526-691076a6d867" containerName="pull" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744534 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e79f8f-23ae-4a07-8526-691076a6d867" containerName="pull" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744546 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerName="pull" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744553 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerName="pull" Jul 03 20:40:03.744564 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744567 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerName="pull" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744575 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerName="pull" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744590 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d15749a-0983-489e-8a31-1ce19e064630" containerName="util" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744599 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d15749a-0983-489e-8a31-1ce19e064630" containerName="util" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744611 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d15749a-0983-489e-8a31-1ce19e064630" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744619 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d15749a-0983-489e-8a31-1ce19e064630" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744632 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744640 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744666 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerName="util" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744674 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerName="util" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744698 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d15749a-0983-489e-8a31-1ce19e064630" containerName="pull" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744707 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d15749a-0983-489e-8a31-1ce19e064630" containerName="pull" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744722 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81e79f8f-23ae-4a07-8526-691076a6d867" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744731 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="81e79f8f-23ae-4a07-8526-691076a6d867" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744833 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ebc9dc4-384d-411a-97d2-52ec4353e8c1" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744846 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d15749a-0983-489e-8a31-1ce19e064630" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744858 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd2937b-d9f0-4911-8ddf-5980058aba76" containerName="extract" Jul 03 20:40:03.745105 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.744867 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="81e79f8f-23ae-4a07-8526-691076a6d867" containerName="extract" Jul 03 20:40:03.750210 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.750184 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.776003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.775975 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8b6445-78jwg"] Jul 03 20:40:03.814075 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.814040 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-serving-cert\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.814265 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.814092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-oauth-config\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.814265 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.814138 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wzzt\" (UniqueName: \"kubernetes.io/projected/0770fd19-ee77-49cf-a996-2d7db7b62e96-kube-api-access-6wzzt\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.814376 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.814260 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-config\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.814376 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.814309 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-trusted-ca-bundle\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.814376 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.814349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-oauth-serving-cert\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.814493 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.814378 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-service-ca\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.876127 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.876089 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:03.915154 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-trusted-ca-bundle\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.915354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-oauth-serving-cert\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.915354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915194 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-service-ca\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.915354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-serving-cert\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.915354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-oauth-config\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.915354 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wzzt\" (UniqueName: \"kubernetes.io/projected/0770fd19-ee77-49cf-a996-2d7db7b62e96-kube-api-access-6wzzt\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.915628 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915356 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-config\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.916021 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.915995 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-oauth-serving-cert\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.916151 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.916030 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-service-ca\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.916223 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.916055 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-config\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.916223 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.916076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0770fd19-ee77-49cf-a996-2d7db7b62e96-trusted-ca-bundle\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.917946 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.917922 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-oauth-config\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.918007 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.917993 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0770fd19-ee77-49cf-a996-2d7db7b62e96-console-serving-cert\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.928007 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.927984 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wzzt\" (UniqueName: \"kubernetes.io/projected/0770fd19-ee77-49cf-a996-2d7db7b62e96-kube-api-access-6wzzt\") pod \"console-6b8b6445-78jwg\" (UID: \"0770fd19-ee77-49cf-a996-2d7db7b62e96\") " pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:03.945304 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:03.945272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:04.021581 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:04.021496 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:04.060056 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:04.060021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:04.194066 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:04.194044 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8b6445-78jwg"] Jul 03 20:40:04.195696 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:40:04.195659 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0770fd19_ee77_49cf_a996_2d7db7b62e96.slice/crio-449b4956c0797a9d40e5061f9a0f7ef1994d895452653b15e50d1fb6821e7c83 WatchSource:0}: Error finding container 449b4956c0797a9d40e5061f9a0f7ef1994d895452653b15e50d1fb6821e7c83: Status 404 returned error can't find the container with id 449b4956c0797a9d40e5061f9a0f7ef1994d895452653b15e50d1fb6821e7c83 Jul 03 20:40:04.252495 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:04.252469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8b6445-78jwg" event={"ID":"0770fd19-ee77-49cf-a996-2d7db7b62e96","Type":"ContainerStarted","Data":"449b4956c0797a9d40e5061f9a0f7ef1994d895452653b15e50d1fb6821e7c83"} Jul 03 20:40:04.482895 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:04.482855 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:04.582645 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:04.582612 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:05.259395 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:05.259366 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8b6445-78jwg" event={"ID":"0770fd19-ee77-49cf-a996-2d7db7b62e96","Type":"ContainerStarted","Data":"a649ef21bdc4dd24fdf9d16a18800cc26abcc9219706ccf3dda64635b3b8e51c"} Jul 03 20:40:05.280449 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:05.280399 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b8b6445-78jwg" podStartSLOduration=2.280384121 podStartE2EDuration="2.280384121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:40:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:40:05.278157547 +0000 UTC m=+462.187018991" watchObservedRunningTime="2026-07-03 20:40:05.280384121 +0000 UTC m=+462.189245563" Jul 03 20:40:10.049395 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:10.049365 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:10.154903 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:10.154857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:14.060382 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:14.060350 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:14.060787 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:14.060407 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:14.064926 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:14.064908 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:14.320653 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:14.320574 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b8b6445-78jwg" Jul 03 20:40:14.373108 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:14.373076 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748b4f84c9-srs6b"] Jul 03 20:40:14.546597 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:14.546566 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:14.640103 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:14.640019 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:15.322707 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:15.322654 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:15.423507 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:15.423474 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:15.726760 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:15.726728 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:15.825993 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:15.825963 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:19.118379 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:19.118330 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:19.219707 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:19.219644 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:21.669769 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:21.669723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:21.770098 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:21.770047 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:38.382057 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.382028 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc"] Jul 03 20:40:38.385550 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.385531 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.388072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.388049 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-tn6f9\"" Jul 03 20:40:38.395708 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.395671 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc"] Jul 03 20:40:38.408240 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.408211 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:38.534219 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534186 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qwfh\" (UniqueName: \"kubernetes.io/projected/33422fb3-60d1-4459-a0e3-24f09ce07ecd-kube-api-access-8qwfh\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534219 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534423 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534258 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534423 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534295 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534423 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534310 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534423 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534404 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534431 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534447 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.534553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.534462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635035 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.634955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635035 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.634995 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635035 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635012 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635300 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635054 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635300 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635073 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635300 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635300 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635300 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635150 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qwfh\" (UniqueName: \"kubernetes.io/projected/33422fb3-60d1-4459-a0e3-24f09ce07ecd-kube-api-access-8qwfh\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635468 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635873 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.635926 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.635901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.637991 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.637970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.638108 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.638091 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.643222 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.643198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33422fb3-60d1-4459-a0e3-24f09ce07ecd-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.643368 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.643351 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qwfh\" (UniqueName: \"kubernetes.io/projected/33422fb3-60d1-4459-a0e3-24f09ce07ecd-kube-api-access-8qwfh\") pod \"maas-default-gateway-openshift-default-56654dcf7-z89xc\" (UID: \"33422fb3-60d1-4459-a0e3-24f09ce07ecd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.697374 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.697346 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:38.834058 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.834026 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc"] Jul 03 20:40:38.835270 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:40:38.835247 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33422fb3_60d1_4459_a0e3_24f09ce07ecd.slice/crio-a0d5d7e6757213c29933feed5c1b92cdc185cfd35c0a9d93be8ba1a5e62619fb WatchSource:0}: Error finding container a0d5d7e6757213c29933feed5c1b92cdc185cfd35c0a9d93be8ba1a5e62619fb: Status 404 returned error can't find the container with id a0d5d7e6757213c29933feed5c1b92cdc185cfd35c0a9d93be8ba1a5e62619fb Jul 03 20:40:38.837447 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.837414 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:40:38.837515 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.837500 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:40:38.837554 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.837527 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:40:38.938463 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:38.938430 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:39.395020 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.394975 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-748b4f84c9-srs6b" podUID="03a4b9cb-d6a5-454c-a6cf-c93cda95825e" containerName="console" containerID="cri-o://8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b" gracePeriod=15 Jul 03 20:40:39.451795 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.451763 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" event={"ID":"33422fb3-60d1-4459-a0e3-24f09ce07ecd","Type":"ContainerStarted","Data":"a142dc7a9f70645a7b10ba2f42e4ba20432277495ca0120e70e89c233f1cd490"} Jul 03 20:40:39.451961 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.451814 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" event={"ID":"33422fb3-60d1-4459-a0e3-24f09ce07ecd","Type":"ContainerStarted","Data":"a0d5d7e6757213c29933feed5c1b92cdc185cfd35c0a9d93be8ba1a5e62619fb"} Jul 03 20:40:39.473944 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.473898 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" podStartSLOduration=1.47388426 podStartE2EDuration="1.47388426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:40:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:40:39.470751377 +0000 UTC m=+496.379612820" watchObservedRunningTime="2026-07-03 20:40:39.47388426 +0000 UTC m=+496.382745701" Jul 03 20:40:39.630883 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.630860 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:40:39.697680 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.697647 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:39.702468 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.702447 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:39.745729 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.745700 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-config\") pod \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " Jul 03 20:40:39.745876 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.745763 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-oauth-serving-cert\") pod \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " Jul 03 20:40:39.745876 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.745799 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lthr\" (UniqueName: \"kubernetes.io/projected/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-kube-api-access-6lthr\") pod \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " Jul 03 20:40:39.745876 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.745836 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-serving-cert\") pod \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " Jul 03 20:40:39.745876 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.745853 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-oauth-config\") pod \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " Jul 03 20:40:39.746097 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.745992 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-trusted-ca-bundle\") pod \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " Jul 03 20:40:39.746097 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746050 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-service-ca\") pod \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\" (UID: \"03a4b9cb-d6a5-454c-a6cf-c93cda95825e\") " Jul 03 20:40:39.746203 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746141 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-config" (OuterVolumeSpecName: "console-config") pod "03a4b9cb-d6a5-454c-a6cf-c93cda95825e" (UID: "03a4b9cb-d6a5-454c-a6cf-c93cda95825e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:40:39.746267 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746242 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "03a4b9cb-d6a5-454c-a6cf-c93cda95825e" (UID: "03a4b9cb-d6a5-454c-a6cf-c93cda95825e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:40:39.746393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746371 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "03a4b9cb-d6a5-454c-a6cf-c93cda95825e" (UID: "03a4b9cb-d6a5-454c-a6cf-c93cda95825e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:40:39.746461 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746373 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-service-ca" (OuterVolumeSpecName: "service-ca") pod "03a4b9cb-d6a5-454c-a6cf-c93cda95825e" (UID: "03a4b9cb-d6a5-454c-a6cf-c93cda95825e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 03 20:40:39.746521 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746508 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-trusted-ca-bundle\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:40:39.746577 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746521 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-service-ca\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:40:39.746577 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746530 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:40:39.746577 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.746538 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-oauth-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:40:39.748068 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.748045 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-kube-api-access-6lthr" (OuterVolumeSpecName: "kube-api-access-6lthr") pod "03a4b9cb-d6a5-454c-a6cf-c93cda95825e" (UID: "03a4b9cb-d6a5-454c-a6cf-c93cda95825e"). InnerVolumeSpecName "kube-api-access-6lthr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:40:39.748414 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.748393 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "03a4b9cb-d6a5-454c-a6cf-c93cda95825e" (UID: "03a4b9cb-d6a5-454c-a6cf-c93cda95825e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:40:39.748484 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.748416 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "03a4b9cb-d6a5-454c-a6cf-c93cda95825e" (UID: "03a4b9cb-d6a5-454c-a6cf-c93cda95825e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 03 20:40:39.847028 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.846996 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-serving-cert\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:40:39.847028 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.847024 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-console-oauth-config\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:40:39.847028 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:39.847033 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lthr\" (UniqueName: \"kubernetes.io/projected/03a4b9cb-d6a5-454c-a6cf-c93cda95825e-kube-api-access-6lthr\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:40:40.458554 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.458519 2578 generic.go:356] "Generic (PLEG): container finished" podID="03a4b9cb-d6a5-454c-a6cf-c93cda95825e" containerID="8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b" exitCode=0 Jul 03 20:40:40.459014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.458563 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-748b4f84c9-srs6b" Jul 03 20:40:40.459014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.458601 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748b4f84c9-srs6b" event={"ID":"03a4b9cb-d6a5-454c-a6cf-c93cda95825e","Type":"ContainerDied","Data":"8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b"} Jul 03 20:40:40.459014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.458655 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-748b4f84c9-srs6b" event={"ID":"03a4b9cb-d6a5-454c-a6cf-c93cda95825e","Type":"ContainerDied","Data":"481b182549d9e89891fb044c1d21228ef7aba0fe2b229e7f603267864ea9d9cb"} Jul 03 20:40:40.459014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.458676 2578 scope.go:117] "RemoveContainer" containerID="8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b" Jul 03 20:40:40.459014 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.459003 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:40.460136 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.460118 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:40:40.468129 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.468113 2578 scope.go:117] "RemoveContainer" containerID="8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b" Jul 03 20:40:40.468353 ip-10-0-128-211 kubenswrapper[2578]: E0703 20:40:40.468339 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b\": container with ID starting with 8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b not found: ID does not exist" containerID="8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b" Jul 03 20:40:40.468398 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.468358 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b"} err="failed to get container status \"8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b\": rpc error: code = NotFound desc = could not find container \"8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b\": container with ID starting with 8bc9fc9817bcf469daa4530d767f1fb12af9d3d2ea5c6d199c0b139835a6f12b not found: ID does not exist" Jul 03 20:40:40.514558 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.514515 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-748b4f84c9-srs6b"] Jul 03 20:40:40.516652 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.516629 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-748b4f84c9-srs6b"] Jul 03 20:40:40.754310 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:40.754232 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a4b9cb-d6a5-454c-a6cf-c93cda95825e" path="/var/lib/kubelet/pods/03a4b9cb-d6a5-454c-a6cf-c93cda95825e/volumes" Jul 03 20:40:51.388412 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:51.388379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:51.486530 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:51.486500 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:51.547172 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:51.547143 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:52.215190 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:52.215147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:40:52.313119 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:40:52.313087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:12.603266 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:12.603231 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:24.623381 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:24.623345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:24.789447 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:24.789410 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:27.866070 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:27.866031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:32.023177 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:32.023138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:32.120257 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:32.120206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:32.212020 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:32.211990 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:35.382047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:35.382009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:41:35.483973 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:41:35.483939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:00.351559 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:00.351509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:00.407047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:00.407015 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:06.757583 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:06.757548 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:07.171573 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.171497 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:07.288463 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.288426 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:07.672078 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.672042 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:07.769627 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.769597 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:07.786656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.786623 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h9nlb"] Jul 03 20:42:07.787009 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.786997 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a4b9cb-d6a5-454c-a6cf-c93cda95825e" containerName="console" Jul 03 20:42:07.787053 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.787011 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a4b9cb-d6a5-454c-a6cf-c93cda95825e" containerName="console" Jul 03 20:42:07.787088 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.787079 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a4b9cb-d6a5-454c-a6cf-c93cda95825e" containerName="console" Jul 03 20:42:07.790019 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.790004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:07.792394 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.792373 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 03 20:42:07.792513 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.792453 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g2mtn\"" Jul 03 20:42:07.799553 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.799529 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h9nlb"] Jul 03 20:42:07.937114 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.937066 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kjx7\" (UniqueName: \"kubernetes.io/projected/5af372f1-b58f-4080-9dff-8e1540b4dc25-kube-api-access-8kjx7\") pod \"payload-pre-processing-7964457696-h9nlb\" (UID: \"5af372f1-b58f-4080-9dff-8e1540b4dc25\") " pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:07.937313 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:07.937161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af372f1-b58f-4080-9dff-8e1540b4dc25-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h9nlb\" (UID: \"5af372f1-b58f-4080-9dff-8e1540b4dc25\") " pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:08.038672 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:08.038629 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kjx7\" (UniqueName: \"kubernetes.io/projected/5af372f1-b58f-4080-9dff-8e1540b4dc25-kube-api-access-8kjx7\") pod \"payload-pre-processing-7964457696-h9nlb\" (UID: \"5af372f1-b58f-4080-9dff-8e1540b4dc25\") " pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:08.038891 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:08.038735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af372f1-b58f-4080-9dff-8e1540b4dc25-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h9nlb\" (UID: \"5af372f1-b58f-4080-9dff-8e1540b4dc25\") " pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:08.039423 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:08.039404 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5af372f1-b58f-4080-9dff-8e1540b4dc25-plugins-config-volume\") pod \"payload-pre-processing-7964457696-h9nlb\" (UID: \"5af372f1-b58f-4080-9dff-8e1540b4dc25\") " pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:08.046851 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:08.046815 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kjx7\" (UniqueName: \"kubernetes.io/projected/5af372f1-b58f-4080-9dff-8e1540b4dc25-kube-api-access-8kjx7\") pod \"payload-pre-processing-7964457696-h9nlb\" (UID: \"5af372f1-b58f-4080-9dff-8e1540b4dc25\") " pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:08.101870 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:08.101831 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:08.234648 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:08.234616 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-h9nlb"] Jul 03 20:42:08.236160 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:42:08.236116 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af372f1_b58f_4080_9dff_8e1540b4dc25.slice/crio-f87a5bb7a59621787e34c5c2cf65ec112489b38b553bbfdd6862cdc859e0d80d WatchSource:0}: Error finding container f87a5bb7a59621787e34c5c2cf65ec112489b38b553bbfdd6862cdc859e0d80d: Status 404 returned error can't find the container with id f87a5bb7a59621787e34c5c2cf65ec112489b38b553bbfdd6862cdc859e0d80d Jul 03 20:42:08.929829 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:08.929793 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" event={"ID":"5af372f1-b58f-4080-9dff-8e1540b4dc25","Type":"ContainerStarted","Data":"f87a5bb7a59621787e34c5c2cf65ec112489b38b553bbfdd6862cdc859e0d80d"} Jul 03 20:42:09.940061 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:09.940019 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" event={"ID":"5af372f1-b58f-4080-9dff-8e1540b4dc25","Type":"ContainerStarted","Data":"c608091ad9c1fc91c50fc31ef77b507a64ce728e31797db139c6787583e32542"} Jul 03 20:42:09.940886 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:09.940862 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:09.960233 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:09.960122 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" podStartSLOduration=1.4951828790000001 podStartE2EDuration="2.960106546s" totalImagesPullingTime="1.464923667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:42:09.957376365 +0000 UTC m=+586.866237808" watchObservedRunningTime="2026-07-03 20:42:09.960106546 +0000 UTC m=+586.868967987" Jul 03 20:42:15.985186 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:15.985150 2578 generic.go:356] "Generic (PLEG): container finished" podID="33422fb3-60d1-4459-a0e3-24f09ce07ecd" containerID="a142dc7a9f70645a7b10ba2f42e4ba20432277495ca0120e70e89c233f1cd490" exitCode=0 Jul 03 20:42:15.985759 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:15.985225 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" event={"ID":"33422fb3-60d1-4459-a0e3-24f09ce07ecd","Type":"ContainerDied","Data":"a142dc7a9f70645a7b10ba2f42e4ba20432277495ca0120e70e89c233f1cd490"} Jul 03 20:42:15.985837 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:15.985766 2578 scope.go:117] "RemoveContainer" containerID="a142dc7a9f70645a7b10ba2f42e4ba20432277495ca0120e70e89c233f1cd490" Jul 03 20:42:15.986794 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:15.986766 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:42:15.986861 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:15.986837 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:42:15.986902 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:15.986872 2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 03 20:42:16.992161 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:16.992130 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" event={"ID":"33422fb3-60d1-4459-a0e3-24f09ce07ecd","Type":"ContainerStarted","Data":"95e66a84c16622e89f42f2b2c5c632c87ab303dc452850c6973765695b6acf32"} Jul 03 20:42:17.697619 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:17.697575 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:42:17.697946 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:17.697918 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z89xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 20:42:17.698009 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:17.697984 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" podUID="33422fb3-60d1-4459-a0e3-24f09ce07ecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 20:42:18.057234 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:18.057147 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:18.698590 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:18.698555 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z89xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 20:42:18.698798 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:18.698612 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" podUID="33422fb3-60d1-4459-a0e3-24f09ce07ecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 20:42:19.344638 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:19.344604 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:19.698335 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:19.698306 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z89xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 20:42:19.698499 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:19.698365 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" podUID="33422fb3-60d1-4459-a0e3-24f09ce07ecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 20:42:20.698196 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:20.698157 2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-z89xc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 03 20:42:20.698583 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:20.698216 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" podUID="33422fb3-60d1-4459-a0e3-24f09ce07ecd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 03 20:42:21.702585 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:21.702555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:42:21.703074 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:21.702967 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:42:21.703590 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:21.703569 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-z89xc" Jul 03 20:42:21.960716 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:21.960594 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-h9nlb" Jul 03 20:42:23.703348 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:23.703317 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:42:23.703826 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:23.703447 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:42:42.078399 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:42.078371 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:42:55.878912 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:42:55.878830 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:43:09.474628 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:09.474593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:43:11.036035 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.036001 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4z852"] Jul 03 20:43:11.039426 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.039409 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.043321 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.043278 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-4vtgc\"" Jul 03 20:43:11.043321 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.043321 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 03 20:43:11.043535 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.043364 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 03 20:43:11.043535 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.043320 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 03 20:43:11.048844 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.048823 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4z852"] Jul 03 20:43:11.061212 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.061185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:43:11.221473 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.221439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.221668 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.221480 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.221668 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.221582 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.221668 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.221617 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.221668 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.221644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.221884 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.221708 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9n89\" (UniqueName: \"kubernetes.io/projected/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-kube-api-access-n9n89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.322830 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.322723 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.322830 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.322779 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.322830 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.322800 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.322830 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.322823 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9n89\" (UniqueName: \"kubernetes.io/projected/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-kube-api-access-n9n89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.323140 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.322988 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.323140 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.323040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.323256 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.323161 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.323256 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.323182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.323398 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.323370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.325024 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.325001 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.325358 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.325338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.331415 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.331395 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9n89\" (UniqueName: \"kubernetes.io/projected/85bf6dd1-9f77-444d-bbfc-f73fe9e699d6-kube-api-access-n9n89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-4z852\" (UID: \"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.351308 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.351281 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:11.484812 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.484785 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-4z852"] Jul 03 20:43:11.487372 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:43:11.487347 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85bf6dd1_9f77_444d_bbfc_f73fe9e699d6.slice/crio-abbc2e3eb26f3e172aea41f681d3604101a388c95ec07064a7ea920465db69b2 WatchSource:0}: Error finding container abbc2e3eb26f3e172aea41f681d3604101a388c95ec07064a7ea920465db69b2: Status 404 returned error can't find the container with id abbc2e3eb26f3e172aea41f681d3604101a388c95ec07064a7ea920465db69b2 Jul 03 20:43:11.488748 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:11.488731 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 03 20:43:12.286305 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:12.286260 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" event={"ID":"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6","Type":"ContainerStarted","Data":"abbc2e3eb26f3e172aea41f681d3604101a388c95ec07064a7ea920465db69b2"} Jul 03 20:43:13.294102 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:13.294069 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" event={"ID":"85bf6dd1-9f77-444d-bbfc-f73fe9e699d6","Type":"ContainerStarted","Data":"ee1612661da0a28e202bd5c54ab083f15b1f2d75688c84ddb23b16b90ffbe892"} Jul 03 20:43:13.312233 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:13.312186 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" podStartSLOduration=1.294098512 podStartE2EDuration="2.312169628s" totalImagesPullingTime="1.018071116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 20:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:43:13.311359311 +0000 UTC m=+650.220220754" watchObservedRunningTime="2026-07-03 20:43:13.312169628 +0000 UTC m=+650.221031070" Jul 03 20:43:21.352178 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:21.352146 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:21.352647 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:21.352205 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:21.364828 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:21.364803 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:22.357054 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:22.357019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-4z852" Jul 03 20:43:27.881478 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:27.881441 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:43:30.822021 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:30.821988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:43:30.880217 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:30.880187 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:43:49.963387 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:49.963354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:43:55.920804 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:43:55.920775 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:44:04.279893 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:44:04.279858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:45:00.142416 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.142384 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29718525-rg7t2"] Jul 03 20:45:00.145840 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.145825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" Jul 03 20:45:00.148530 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.148510 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pjhz5\"" Jul 03 20:45:00.152812 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.152786 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718525-rg7t2"] Jul 03 20:45:00.194477 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.194439 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwh6t\" (UniqueName: \"kubernetes.io/projected/b8f532cc-3052-4895-8e2b-eb4cd9067497-kube-api-access-xwh6t\") pod \"maas-api-key-cleanup-29718525-rg7t2\" (UID: \"b8f532cc-3052-4895-8e2b-eb4cd9067497\") " pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" Jul 03 20:45:00.295556 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.295518 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwh6t\" (UniqueName: \"kubernetes.io/projected/b8f532cc-3052-4895-8e2b-eb4cd9067497-kube-api-access-xwh6t\") pod \"maas-api-key-cleanup-29718525-rg7t2\" (UID: \"b8f532cc-3052-4895-8e2b-eb4cd9067497\") " pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" Jul 03 20:45:00.313358 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.313335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwh6t\" (UniqueName: \"kubernetes.io/projected/b8f532cc-3052-4895-8e2b-eb4cd9067497-kube-api-access-xwh6t\") pod \"maas-api-key-cleanup-29718525-rg7t2\" (UID: \"b8f532cc-3052-4895-8e2b-eb4cd9067497\") " pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" Jul 03 20:45:00.458276 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.458246 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" Jul 03 20:45:00.595322 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.595297 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29718525-rg7t2"] Jul 03 20:45:00.597181 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:45:00.597155 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f532cc_3052_4895_8e2b_eb4cd9067497.slice/crio-5b7d15892633edd56106af95ae827c91bb2557985738bbbfa3c8ab6ee6f40561 WatchSource:0}: Error finding container 5b7d15892633edd56106af95ae827c91bb2557985738bbbfa3c8ab6ee6f40561: Status 404 returned error can't find the container with id 5b7d15892633edd56106af95ae827c91bb2557985738bbbfa3c8ab6ee6f40561 Jul 03 20:45:00.884753 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:00.884642 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" event={"ID":"b8f532cc-3052-4895-8e2b-eb4cd9067497","Type":"ContainerStarted","Data":"5b7d15892633edd56106af95ae827c91bb2557985738bbbfa3c8ab6ee6f40561"} Jul 03 20:45:03.903533 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:03.903435 2578 generic.go:356] "Generic (PLEG): container finished" podID="b8f532cc-3052-4895-8e2b-eb4cd9067497" containerID="effdc73b321d6544c5b6e045f0b1cd776b432ad981cdca0c8f3c88cca11e9ce7" exitCode=0 Jul 03 20:45:03.903533 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:03.903485 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" event={"ID":"b8f532cc-3052-4895-8e2b-eb4cd9067497","Type":"ContainerDied","Data":"effdc73b321d6544c5b6e045f0b1cd776b432ad981cdca0c8f3c88cca11e9ce7"} Jul 03 20:45:05.041653 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:05.041634 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" Jul 03 20:45:05.142347 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:05.142242 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwh6t\" (UniqueName: \"kubernetes.io/projected/b8f532cc-3052-4895-8e2b-eb4cd9067497-kube-api-access-xwh6t\") pod \"b8f532cc-3052-4895-8e2b-eb4cd9067497\" (UID: \"b8f532cc-3052-4895-8e2b-eb4cd9067497\") " Jul 03 20:45:05.144382 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:05.144355 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f532cc-3052-4895-8e2b-eb4cd9067497-kube-api-access-xwh6t" (OuterVolumeSpecName: "kube-api-access-xwh6t") pod "b8f532cc-3052-4895-8e2b-eb4cd9067497" (UID: "b8f532cc-3052-4895-8e2b-eb4cd9067497"). InnerVolumeSpecName "kube-api-access-xwh6t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 03 20:45:05.243825 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:05.243791 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwh6t\" (UniqueName: \"kubernetes.io/projected/b8f532cc-3052-4895-8e2b-eb4cd9067497-kube-api-access-xwh6t\") on node \"ip-10-0-128-211.ec2.internal\" DevicePath \"\"" Jul 03 20:45:05.916165 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:05.916131 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" Jul 03 20:45:05.916355 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:05.916183 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29718525-rg7t2" event={"ID":"b8f532cc-3052-4895-8e2b-eb4cd9067497","Type":"ContainerDied","Data":"5b7d15892633edd56106af95ae827c91bb2557985738bbbfa3c8ab6ee6f40561"} Jul 03 20:45:05.916355 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:05.916240 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b7d15892633edd56106af95ae827c91bb2557985738bbbfa3c8ab6ee6f40561" Jul 03 20:45:08.774360 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:08.774323 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:45:50.295184 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:50.295103 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:45:50.391874 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:50.391844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:45:51.532222 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:51.532184 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:45:51.630150 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:45:51.630123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:46:27.660090 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:46:27.660054 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:47:14.651144 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:47:14.651095 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:47:23.740107 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:47:23.740079 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:47:23.741046 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:47:23.741025 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:49:02.488767 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:49:02.488720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:49:04.084651 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:49:04.084622 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:51:51.197670 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:51:51.197599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:51:51.281143 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:51:51.281115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:51:51.393047 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:51:51.393016 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:51:57.050823 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:51:57.050794 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:51:57.162236 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:51:57.162206 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:51:57.250997 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:51:57.250967 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:51:57.466777 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:51:57.466741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:52:03.067098 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:52:03.067062 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:52:03.169179 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:52:03.169142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:52:23.775726 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:52:23.775700 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:52:23.781473 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:52:23.781453 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:53:47.011043 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:53:47.010958 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:54:30.098776 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:54:30.098741 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:55:27.486157 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:55:27.486117 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:55:27.587582 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:55:27.587551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:57:23.815148 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:23.815024 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:57:23.823113 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:23.823095 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:57:38.296175 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:38.296147 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718525-rg7t2_b8f532cc-3052-4895-8e2b-eb4cd9067497/cleanup/0.log" Jul 03 20:57:39.039842 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:39.039812 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8554cfd646-pqhbt_ecc906da-0b09-4e21-8f2d-b8eb47af8eed/copy-manifests/0.log" Jul 03 20:57:39.046769 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:39.046744 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8554cfd646-pqhbt_ecc906da-0b09-4e21-8f2d-b8eb47af8eed/manager/0.log" Jul 03 20:57:39.943275 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:39.943248 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w_3ebc9dc4-384d-411a-97d2-52ec4353e8c1/pull/0.log" Jul 03 20:57:39.949824 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:39.949803 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w_3ebc9dc4-384d-411a-97d2-52ec4353e8c1/extract/0.log" Jul 03 20:57:39.955877 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:39.955855 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w_3ebc9dc4-384d-411a-97d2-52ec4353e8c1/util/0.log" Jul 03 20:57:40.070249 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.070222 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf_0d15749a-0983-489e-8a31-1ce19e064630/util/0.log" Jul 03 20:57:40.076305 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.076279 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf_0d15749a-0983-489e-8a31-1ce19e064630/pull/0.log" Jul 03 20:57:40.082066 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.082046 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf_0d15749a-0983-489e-8a31-1ce19e064630/extract/0.log" Jul 03 20:57:40.196199 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.196122 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg_8fd2937b-d9f0-4911-8ddf-5980058aba76/util/0.log" Jul 03 20:57:40.203108 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.203089 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg_8fd2937b-d9f0-4911-8ddf-5980058aba76/pull/0.log" Jul 03 20:57:40.210266 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.210244 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg_8fd2937b-d9f0-4911-8ddf-5980058aba76/extract/0.log" Jul 03 20:57:40.324567 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.324541 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7_81e79f8f-23ae-4a07-8526-691076a6d867/util/0.log" Jul 03 20:57:40.330676 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.330657 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7_81e79f8f-23ae-4a07-8526-691076a6d867/pull/0.log" Jul 03 20:57:40.336498 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:40.336479 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7_81e79f8f-23ae-4a07-8526-691076a6d867/extract/0.log" Jul 03 20:57:41.716227 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:41.716184 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd6bl_0c8fa598-c6a4-48f1-8828-e31c4674cb91/istio-proxy/0.log" Jul 03 20:57:41.837196 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:41.837167 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d9mlw_b1edc714-b9dc-43dc-9477-05dbaccfcdef/discovery/0.log" Jul 03 20:57:42.179745 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:42.179720 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z89xc_33422fb3-60d1-4459-a0e3-24f09ce07ecd/istio-proxy/1.log" Jul 03 20:57:42.296624 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:42.296600 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h9nlb_5af372f1-b58f-4080-9dff-8e1540b4dc25/payload-pre-processing/0.log" Jul 03 20:57:43.101222 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:43.101197 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-4z852_85bf6dd1-9f77-444d-bbfc-f73fe9e699d6/main/0.log" Jul 03 20:57:48.823798 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:48.823705 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:57:48.890434 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:48.890406 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" limit=1024 Jul 03 20:57:50.758020 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:50.757988 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2lk2t_4b8c6c6b-9db0-4bb3-b254-a06244f079b8/global-pull-secret-syncer/0.log" Jul 03 20:57:50.887222 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:50.887192 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6kblm_a8530568-b428-4888-b148-e43cd575d1a5/konnectivity-agent/0.log" Jul 03 20:57:50.967545 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:50.967521 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-211.ec2.internal_4e7ee0ea579cbfd49e6032150d18c00c/haproxy/0.log" Jul 03 20:57:55.221588 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.221557 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w_3ebc9dc4-384d-411a-97d2-52ec4353e8c1/extract/0.log" Jul 03 20:57:55.242027 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.242002 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w_3ebc9dc4-384d-411a-97d2-52ec4353e8c1/util/0.log" Jul 03 20:57:55.264097 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.264071 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759nmk2w_3ebc9dc4-384d-411a-97d2-52ec4353e8c1/pull/0.log" Jul 03 20:57:55.298656 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.298630 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf_0d15749a-0983-489e-8a31-1ce19e064630/extract/0.log" Jul 03 20:57:55.320894 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.320869 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf_0d15749a-0983-489e-8a31-1ce19e064630/util/0.log" Jul 03 20:57:55.348050 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.348026 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hnqpf_0d15749a-0983-489e-8a31-1ce19e064630/pull/0.log" Jul 03 20:57:55.371159 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.371122 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg_8fd2937b-d9f0-4911-8ddf-5980058aba76/extract/0.log" Jul 03 20:57:55.390054 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.390031 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg_8fd2937b-d9f0-4911-8ddf-5980058aba76/util/0.log" Jul 03 20:57:55.412397 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.412372 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73z6jgg_8fd2937b-d9f0-4911-8ddf-5980058aba76/pull/0.log" Jul 03 20:57:55.443632 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.443608 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7_81e79f8f-23ae-4a07-8526-691076a6d867/extract/0.log" Jul 03 20:57:55.463043 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.463019 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7_81e79f8f-23ae-4a07-8526-691076a6d867/util/0.log" Jul 03 20:57:55.481663 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:55.481601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1xfvs7_81e79f8f-23ae-4a07-8526-691076a6d867/pull/0.log" Jul 03 20:57:57.571659 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.571635 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e600b31-4558-4f0c-871f-307e811b71ac/alertmanager/0.log" Jul 03 20:57:57.597074 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.597048 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e600b31-4558-4f0c-871f-307e811b71ac/config-reloader/0.log" Jul 03 20:57:57.620138 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.620104 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e600b31-4558-4f0c-871f-307e811b71ac/kube-rbac-proxy-web/0.log" Jul 03 20:57:57.639019 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.638996 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e600b31-4558-4f0c-871f-307e811b71ac/kube-rbac-proxy/0.log" Jul 03 20:57:57.657839 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.657816 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e600b31-4558-4f0c-871f-307e811b71ac/kube-rbac-proxy-metric/0.log" Jul 03 20:57:57.677251 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.677231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e600b31-4558-4f0c-871f-307e811b71ac/prom-label-proxy/0.log" Jul 03 20:57:57.699462 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.699436 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3e600b31-4558-4f0c-871f-307e811b71ac/init-config-reloader/0.log" Jul 03 20:57:57.779275 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.779247 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mxmkq_b42dec76-8fa7-4e85-9494-c3d77408cd7f/kube-state-metrics/0.log" Jul 03 20:57:57.799358 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.799333 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mxmkq_b42dec76-8fa7-4e85-9494-c3d77408cd7f/kube-rbac-proxy-main/0.log" Jul 03 20:57:57.821871 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.821797 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mxmkq_b42dec76-8fa7-4e85-9494-c3d77408cd7f/kube-rbac-proxy-self/0.log" Jul 03 20:57:57.849610 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.849585 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76bd84d-7kljq_867103fb-39b9-4422-b4bb-4d8ccaed3bbb/metrics-server/0.log" Jul 03 20:57:57.875883 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:57.875854 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-lft6c_46064ee0-1c1e-4b39-bd20-a3a5a3cd1080/monitoring-plugin/0.log" Jul 03 20:57:58.069300 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.069260 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rttff_dcef19da-72ff-4ffc-93d3-f25c2ad80274/node-exporter/0.log" Jul 03 20:57:58.095715 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.095630 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rttff_dcef19da-72ff-4ffc-93d3-f25c2ad80274/kube-rbac-proxy/0.log" Jul 03 20:57:58.129994 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.129965 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rttff_dcef19da-72ff-4ffc-93d3-f25c2ad80274/init-textfile/0.log" Jul 03 20:57:58.162765 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.162739 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-86pdw_499d996a-7267-4ae7-b5f0-2497805f9921/kube-rbac-proxy-main/0.log" Jul 03 20:57:58.197072 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.197049 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-86pdw_499d996a-7267-4ae7-b5f0-2497805f9921/kube-rbac-proxy-self/0.log" Jul 03 20:57:58.218193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.218169 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-86pdw_499d996a-7267-4ae7-b5f0-2497805f9921/openshift-state-metrics/0.log" Jul 03 20:57:58.594664 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.594637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gbf9b_0fc5c94e-c945-4d26-8f84-abd5711b8732/prometheus-operator/0.log" Jul 03 20:57:58.615229 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.615201 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gbf9b_0fc5c94e-c945-4d26-8f84-abd5711b8732/kube-rbac-proxy/0.log" Jul 03 20:57:58.648003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.647977 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-vjg5f_929bae0d-82b6-41d9-87bc-56bb07b249d8/prometheus-operator-admission-webhook/0.log" Jul 03 20:57:58.686528 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.686501 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bf7ff5b8-7npj9_3225f018-d309-40cf-ac5e-849420cbaa07/telemeter-client/0.log" Jul 03 20:57:58.714934 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.714899 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bf7ff5b8-7npj9_3225f018-d309-40cf-ac5e-849420cbaa07/reload/0.log" Jul 03 20:57:58.740440 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.740418 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8bf7ff5b8-7npj9_3225f018-d309-40cf-ac5e-849420cbaa07/kube-rbac-proxy/0.log" Jul 03 20:57:58.769967 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.769927 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554fdcb6c4-cx672_3ca00bb0-1577-4292-bbcc-4997010f07e5/thanos-query/0.log" Jul 03 20:57:58.790501 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.790475 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554fdcb6c4-cx672_3ca00bb0-1577-4292-bbcc-4997010f07e5/kube-rbac-proxy-web/0.log" Jul 03 20:57:58.812248 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.812223 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554fdcb6c4-cx672_3ca00bb0-1577-4292-bbcc-4997010f07e5/kube-rbac-proxy/0.log" Jul 03 20:57:58.831965 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.831941 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554fdcb6c4-cx672_3ca00bb0-1577-4292-bbcc-4997010f07e5/prom-label-proxy/0.log" Jul 03 20:57:58.852657 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.852574 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554fdcb6c4-cx672_3ca00bb0-1577-4292-bbcc-4997010f07e5/kube-rbac-proxy-rules/0.log" Jul 03 20:57:58.871931 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:57:58.871905 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-554fdcb6c4-cx672_3ca00bb0-1577-4292-bbcc-4997010f07e5/kube-rbac-proxy-metrics/0.log" Jul 03 20:58:01.140249 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.140214 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz"] Jul 03 20:58:01.141081 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.140842 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f532cc-3052-4895-8e2b-eb4cd9067497" containerName="cleanup" Jul 03 20:58:01.141081 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.140863 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f532cc-3052-4895-8e2b-eb4cd9067497" containerName="cleanup" Jul 03 20:58:01.141081 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.140987 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f532cc-3052-4895-8e2b-eb4cd9067497" containerName="cleanup" Jul 03 20:58:01.144193 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.144175 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.147114 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.147097 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47n4w\"/\"kube-root-ca.crt\"" Jul 03 20:58:01.148026 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.147997 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47n4w\"/\"openshift-service-ca.crt\"" Jul 03 20:58:01.148133 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.148005 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47n4w\"/\"default-dockercfg-44r9n\"" Jul 03 20:58:01.152342 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.152297 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz"] Jul 03 20:58:01.253657 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.253619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grb8b\" (UniqueName: \"kubernetes.io/projected/38617ae7-9c54-4f80-8dd6-ef603de778f5-kube-api-access-grb8b\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.253657 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.253662 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-proc\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.253886 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.253714 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-lib-modules\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.253886 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.253782 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-podres\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.253886 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.253837 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-sys\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.272168 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.272143 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6b8b6445-78jwg_0770fd19-ee77-49cf-a996-2d7db7b62e96/console/0.log" Jul 03 20:58:01.354825 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.354789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-sys\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.354856 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grb8b\" (UniqueName: \"kubernetes.io/projected/38617ae7-9c54-4f80-8dd6-ef603de778f5-kube-api-access-grb8b\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.354881 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-proc\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.354896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-lib-modules\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.354932 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-sys\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.354968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-podres\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355003 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.355000 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-proc\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355236 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.355065 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-lib-modules\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.355236 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.355095 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38617ae7-9c54-4f80-8dd6-ef603de778f5-podres\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.363760 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.363735 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grb8b\" (UniqueName: \"kubernetes.io/projected/38617ae7-9c54-4f80-8dd6-ef603de778f5-kube-api-access-grb8b\") pod \"perf-node-gather-daemonset-4v8tz\" (UID: \"38617ae7-9c54-4f80-8dd6-ef603de778f5\") " pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.455587 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.455557 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:01.589393 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:01.589364 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz"] Jul 03 20:58:01.590740 ip-10-0-128-211 kubenswrapper[2578]: W0703 20:58:01.590714 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38617ae7_9c54_4f80_8dd6_ef603de778f5.slice/crio-81917dcb1025b611b1b87ddf2516dc9ddb0f34d8a416de486d0c71527615f790 WatchSource:0}: Error finding container 81917dcb1025b611b1b87ddf2516dc9ddb0f34d8a416de486d0c71527615f790: Status 404 returned error can't find the container with id 81917dcb1025b611b1b87ddf2516dc9ddb0f34d8a416de486d0c71527615f790 Jul 03 20:58:02.161924 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:02.161886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" event={"ID":"38617ae7-9c54-4f80-8dd6-ef603de778f5","Type":"ContainerStarted","Data":"bda94d496b6aa83551ec555309954c44163d5a5ae7b5f633b8ac5d4aaf111662"} Jul 03 20:58:02.162373 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:02.161943 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:02.162373 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:02.161964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" event={"ID":"38617ae7-9c54-4f80-8dd6-ef603de778f5","Type":"ContainerStarted","Data":"81917dcb1025b611b1b87ddf2516dc9ddb0f34d8a416de486d0c71527615f790"} Jul 03 20:58:02.179897 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:02.179845 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" podStartSLOduration=1.179826416 podStartE2EDuration="1.179826416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 20:58:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 20:58:02.177549847 +0000 UTC m=+1539.086411326" watchObservedRunningTime="2026-07-03 20:58:02.179826416 +0000 UTC m=+1539.088687858" Jul 03 20:58:02.900070 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:02.900036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d48rr_65e63a2b-03c0-426c-991a-9adcdebc0fe8/dns/0.log" Jul 03 20:58:02.919077 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:02.919052 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d48rr_65e63a2b-03c0-426c-991a-9adcdebc0fe8/kube-rbac-proxy/0.log" Jul 03 20:58:03.071176 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:03.071152 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p69p8_bf3231d3-dbaa-41b0-9161-dfb944d217cb/dns-node-resolver/0.log" Jul 03 20:58:03.669284 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:03.669258 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qzjfr_a08d2054-2cbe-4894-b30f-27fd2dca84ac/node-ca/0.log" Jul 03 20:58:04.558739 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:04.558711 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd6bl_0c8fa598-c6a4-48f1-8828-e31c4674cb91/istio-proxy/0.log" Jul 03 20:58:04.602775 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:04.602746 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d9mlw_b1edc714-b9dc-43dc-9477-05dbaccfcdef/discovery/0.log" Jul 03 20:58:04.674472 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:04.674436 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z89xc_33422fb3-60d1-4459-a0e3-24f09ce07ecd/istio-proxy/0.log" Jul 03 20:58:04.687650 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:04.687620 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z89xc_33422fb3-60d1-4459-a0e3-24f09ce07ecd/istio-proxy/1.log" Jul 03 20:58:04.710614 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:04.710586 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h9nlb_5af372f1-b58f-4080-9dff-8e1540b4dc25/payload-pre-processing/0.log" Jul 03 20:58:05.353168 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:05.353135 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6mmvh_784a7e9f-7d55-4c90-b24d-9e75520b1555/serve-healthcheck-canary/0.log" Jul 03 20:58:05.945271 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:05.945239 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j89p9_de36a72b-d1c3-4443-b335-87025482c364/kube-rbac-proxy/0.log" Jul 03 20:58:05.964373 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:05.964347 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j89p9_de36a72b-d1c3-4443-b335-87025482c364/exporter/0.log" Jul 03 20:58:05.983258 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:05.983231 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j89p9_de36a72b-d1c3-4443-b335-87025482c364/extractor/0.log" Jul 03 20:58:08.177758 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:08.177730 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47n4w/perf-node-gather-daemonset-4v8tz" Jul 03 20:58:08.196388 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:08.196360 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29718525-rg7t2_b8f532cc-3052-4895-8e2b-eb4cd9067497/cleanup/0.log" Jul 03 20:58:08.459405 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:08.459329 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8554cfd646-pqhbt_ecc906da-0b09-4e21-8f2d-b8eb47af8eed/manager/0.log" Jul 03 20:58:08.479570 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:08.479545 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8554cfd646-pqhbt_ecc906da-0b09-4e21-8f2d-b8eb47af8eed/copy-manifests/0.log" Jul 03 20:58:09.750458 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:09.750426 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66fb5847b8-444b2_0d66d550-e256-489e-a1a8-59bc0baf6df8/manager/0.log" Jul 03 20:58:09.797057 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:09.797034 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ztwcn_f25e0d3c-d7b4-426c-8950-3cf5b3b15610/openshift-lws-operator/0.log" Jul 03 20:58:11.392832 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:11.392752 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd6bl_0c8fa598-c6a4-48f1-8828-e31c4674cb91/istio-proxy/0.log" Jul 03 20:58:11.432068 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:11.432036 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d9mlw_b1edc714-b9dc-43dc-9477-05dbaccfcdef/discovery/0.log" Jul 03 20:58:11.472215 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:11.472153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z89xc_33422fb3-60d1-4459-a0e3-24f09ce07ecd/istio-proxy/0.log" Jul 03 20:58:11.486778 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:11.486756 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z89xc_33422fb3-60d1-4459-a0e3-24f09ce07ecd/istio-proxy/1.log" Jul 03 20:58:11.500015 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:11.499990 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h9nlb_5af372f1-b58f-4080-9dff-8e1540b4dc25/payload-pre-processing/0.log" Jul 03 20:58:12.620917 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:12.620887 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xd6bl_0c8fa598-c6a4-48f1-8828-e31c4674cb91/istio-proxy/0.log" Jul 03 20:58:12.662975 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:12.662948 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-d9mlw_b1edc714-b9dc-43dc-9477-05dbaccfcdef/discovery/0.log" Jul 03 20:58:12.719336 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:12.719305 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z89xc_33422fb3-60d1-4459-a0e3-24f09ce07ecd/istio-proxy/0.log" Jul 03 20:58:12.733360 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:12.733334 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-z89xc_33422fb3-60d1-4459-a0e3-24f09ce07ecd/istio-proxy/1.log" Jul 03 20:58:12.748857 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:12.748831 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-h9nlb_5af372f1-b58f-4080-9dff-8e1540b4dc25/payload-pre-processing/0.log" Jul 03 20:58:16.517638 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.517608 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpshh_023867ee-5a9b-4c79-a0f0-c0a67b57beb5/kube-multus-additional-cni-plugins/0.log" Jul 03 20:58:16.542979 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.542955 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpshh_023867ee-5a9b-4c79-a0f0-c0a67b57beb5/egress-router-binary-copy/0.log" Jul 03 20:58:16.562820 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.562793 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpshh_023867ee-5a9b-4c79-a0f0-c0a67b57beb5/cni-plugins/0.log" Jul 03 20:58:16.584768 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.584744 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpshh_023867ee-5a9b-4c79-a0f0-c0a67b57beb5/bond-cni-plugin/0.log" Jul 03 20:58:16.604368 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.604345 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpshh_023867ee-5a9b-4c79-a0f0-c0a67b57beb5/routeoverride-cni/0.log" Jul 03 20:58:16.627824 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.627802 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpshh_023867ee-5a9b-4c79-a0f0-c0a67b57beb5/whereabouts-cni-bincopy/0.log" Jul 03 20:58:16.646980 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.646953 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpshh_023867ee-5a9b-4c79-a0f0-c0a67b57beb5/whereabouts-cni/0.log" Jul 03 20:58:16.865751 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.865661 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-s7zdt_e898b144-956a-47c2-b36f-7b1348460296/kube-multus/0.log" Jul 03 20:58:16.926447 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.926417 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frps2_68bc84f9-c740-4bff-880b-52f29d27cf05/network-metrics-daemon/0.log" Jul 03 20:58:16.946321 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:16.946300 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-frps2_68bc84f9-c740-4bff-880b-52f29d27cf05/kube-rbac-proxy/0.log" Jul 03 20:58:18.193700 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.193653 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-controller/0.log" Jul 03 20:58:18.209486 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.209464 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/0.log" Jul 03 20:58:18.209486 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.209471 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovn-acl-logging/1.log" Jul 03 20:58:18.225028 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.225003 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/kube-rbac-proxy-node/0.log" Jul 03 20:58:18.251183 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.251156 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/kube-rbac-proxy-ovn-metrics/0.log" Jul 03 20:58:18.271527 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.271502 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/northd/0.log" Jul 03 20:58:18.291353 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.291328 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/nbdb/0.log" Jul 03 20:58:18.315853 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.315827 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/sbdb/0.log" Jul 03 20:58:18.355270 ip-10-0-128-211 kubenswrapper[2578]: I0703 20:58:18.355240 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsv94_5635349a-95d8-431d-94aa-c7831bd122a2/ovnkube-controller/0.log"