Jul 08 18:14:19.093000 ip-10-0-130-158 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 08 18:14:19.093011 ip-10-0-130-158 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 08 18:14:19.093021 ip-10-0-130-158 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 08 18:14:19.093330 ip-10-0-130-158 systemd[1]: Failed to start Kubernetes Kubelet. Jul 08 18:14:29.121535 ip-10-0-130-158 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 08 18:14:29.121553 ip-10-0-130-158 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1bd976322b8f4e8798edeb0ef8f41f6a -- Jul 08 18:16:25.555048 ip-10-0-130-158 systemd[1]: Starting Kubernetes Kubelet... Jul 08 18:16:25.911305 ip-10-0-130-158 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:16:25.911305 ip-10-0-130-158 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 18:16:25.911305 ip-10-0-130-158 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:16:25.911305 ip-10-0-130-158 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 18:16:25.911305 ip-10-0-130-158 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:16:25.913881 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.913819 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 18:16:25.917442 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917428 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:25.917442 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917442 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:25.917442 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917445 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917449 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917453 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917456 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917459 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917462 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917465 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917468 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917471 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917473 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917476 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917479 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917481 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917486 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917489 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917492 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917494 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917496 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917499 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917501 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:25.917534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917504 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917507 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917509 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917511 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917514 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917516 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917519 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917521 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917523 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917525 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917530 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917533 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917536 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917539 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917542 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917545 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917548 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917558 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917561 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:25.918013 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917563 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917566 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917569 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917571 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917574 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917577 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917580 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917582 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917585 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917587 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917589 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917593 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917597 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917600 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917602 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917605 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917607 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917610 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917613 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:25.918482 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917617 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917620 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917623 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917625 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917628 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917631 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917634 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917636 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917639 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917641 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917644 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917647 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917649 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917651 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917654 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917656 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917659 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917661 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917664 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917666 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:25.918944 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917669 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917671 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917673 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917676 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917678 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917680 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917682 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917685 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917688 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917690 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917693 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917695 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917697 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917700 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917702 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917705 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917707 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917710 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.917712 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:25.919435 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918348 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918354 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918356 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918359 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918361 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918364 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918367 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918370 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918372 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918375 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918377 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918380 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918382 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918385 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918387 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918390 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918392 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918395 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918398 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:25.919936 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918401 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918404 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918407 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918411 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918415 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918418 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918420 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918423 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918425 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918428 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918430 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918432 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918436 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918438 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918441 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918443 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918446 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918448 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918451 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:25.920394 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918454 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918456 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918460 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918462 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918465 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918467 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918470 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918472 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918474 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918477 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918479 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918482 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918485 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918487 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918490 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918493 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918496 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918498 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918501 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918504 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:25.920897 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918506 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918509 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918511 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918513 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918516 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918518 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918521 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918523 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918526 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918528 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918530 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918533 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918535 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918547 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918549 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918551 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918554 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918556 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918559 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918561 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:25.921360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918563 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918567 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918569 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918572 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918575 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918578 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918582 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918586 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918589 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918592 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918594 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918598 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918600 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918603 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918606 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918608 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918611 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918613 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918616 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:25.921852 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918618 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918620 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918963 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918968 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918970 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918973 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918976 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918979 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918982 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918984 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918987 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918989 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918992 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918994 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918997 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.918999 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919002 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919004 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919007 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919010 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:25.922297 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919012 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919015 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919019 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919021 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919024 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919026 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919029 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919031 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919034 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919037 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919039 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919041 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919044 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919046 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919049 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919051 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919053 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919056 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919059 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:25.922753 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919061 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919064 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919066 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919069 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919071 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919073 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919076 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919078 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919081 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919084 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919086 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919088 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919091 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919093 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919095 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919098 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919101 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919103 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919107 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:25.923225 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919110 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919113 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919116 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919119 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919121 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919124 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919126 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919129 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919132 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919134 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919137 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919139 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919141 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919144 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919147 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919149 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919151 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919156 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919159 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:25.923709 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919161 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919166 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919169 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919172 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919174 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919177 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919180 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919182 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919185 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919187 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919190 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919192 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919195 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919198 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919200 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919202 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919205 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919207 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919210 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919212 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:25.924176 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919224 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919227 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919229 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919232 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919316 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919325 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919334 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919339 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919343 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919346 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919350 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919354 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919357 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919362 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919366 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919369 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919372 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919375 2558 flags.go:64] FLAG: --cgroup-root="" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919378 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919381 2558 flags.go:64] FLAG: --client-ca-file="" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919383 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919386 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919390 2558 flags.go:64] FLAG: --cluster-domain="" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919393 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 18:16:25.924664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919396 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919399 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919402 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919405 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919408 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919411 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919414 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919417 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919420 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919422 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919425 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919428 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919432 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919435 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919438 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919441 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919444 2558 flags.go:64] FLAG: --enable-server="true" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919447 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919452 2558 flags.go:64] FLAG: --event-burst="100" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919457 2558 flags.go:64] FLAG: --event-qps="50" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919460 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919464 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919467 2558 flags.go:64] FLAG: --eviction-hard="" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919471 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 18:16:25.925228 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919473 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919477 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919479 2558 flags.go:64] FLAG: --eviction-soft="" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919482 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919485 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919488 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919491 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919493 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919496 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919499 2558 flags.go:64] FLAG: --feature-gates="" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919502 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919505 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919508 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919511 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919514 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919517 2558 flags.go:64] FLAG: --help="false" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919519 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-130-158.ec2.internal" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919522 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919525 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919528 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919531 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919534 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919537 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 18:16:25.925770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919539 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919542 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919545 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919548 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919552 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919555 2558 flags.go:64] FLAG: --kube-reserved="" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919559 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919562 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919565 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919568 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919570 2558 flags.go:64] FLAG: --lock-file="" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919573 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919576 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919579 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919584 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919587 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919589 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919592 2558 flags.go:64] FLAG: --logging-format="text" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919595 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919598 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919601 2558 flags.go:64] FLAG: --manifest-url="" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919603 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919607 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919610 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919614 2558 flags.go:64] FLAG: --max-pods="110" Jul 08 18:16:25.926376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919617 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919619 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919622 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919624 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919627 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919630 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919633 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919639 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919642 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919645 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919648 2558 flags.go:64] FLAG: --pod-cidr="" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919653 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919658 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919662 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919665 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919668 2558 flags.go:64] FLAG: --port="10250" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919671 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919673 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b2785b5a3e7da219" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919677 2558 flags.go:64] FLAG: --qos-reserved="" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919679 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919682 2558 flags.go:64] FLAG: --register-node="true" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919685 2558 flags.go:64] FLAG: --register-with-taints="" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919688 2558 flags.go:64] FLAG: --registry-burst="10" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919691 2558 flags.go:64] FLAG: --registry-qps="5" Jul 08 18:16:25.926988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919694 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919697 2558 flags.go:64] FLAG: --reserved-memory="" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919700 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919703 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919706 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919708 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919711 2558 flags.go:64] FLAG: --runonce="false" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919714 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919717 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919720 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919723 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919725 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919728 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919731 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919734 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919736 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919739 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919742 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919744 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919747 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919752 2558 flags.go:64] FLAG: --system-cgroups="" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919756 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919761 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919763 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919766 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 18:16:25.927594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919770 2558 flags.go:64] FLAG: --tls-min-version="" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919773 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919775 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919778 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919781 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919783 2558 flags.go:64] FLAG: --v="2" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919787 2558 flags.go:64] FLAG: --version="false" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919790 2558 flags.go:64] FLAG: --vmodule="" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919794 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.919797 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919925 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919929 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919932 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919935 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919937 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919942 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919945 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919948 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919951 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919954 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919957 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:25.928215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919960 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919962 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919965 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919967 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919970 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919973 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919977 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919981 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919983 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919986 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919988 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919991 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919993 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919996 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.919999 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920001 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920004 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920006 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920009 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:25.928725 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920011 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920014 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920016 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920019 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920021 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920024 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920026 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920029 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920031 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920034 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920036 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920038 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920041 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920043 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920047 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920051 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920054 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920057 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920059 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920064 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:25.929185 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920068 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920070 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920073 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920075 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920080 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920083 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920086 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920089 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920092 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920095 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920097 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920100 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920102 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920105 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920108 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920110 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920113 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920115 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920118 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920120 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:25.929701 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920122 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920125 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920127 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920130 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920133 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920135 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920138 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920140 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920142 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920145 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920147 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920151 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920155 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920157 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920160 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920163 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920166 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920168 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920171 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920173 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:25.930188 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920176 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920179 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920181 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920184 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920186 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920189 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920191 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920194 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.920196 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.920202 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.926065 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.926078 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.926095 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.926103 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926156 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:25.930657 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926160 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926164 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926167 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926170 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926172 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926175 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926178 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926180 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926183 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926186 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926188 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926192 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926194 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926197 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926199 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926202 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926204 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926207 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926209 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926212 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:25.931034 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926214 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926217 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926219 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926222 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926224 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926227 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926230 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926232 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926235 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926238 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926240 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926243 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926246 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926248 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926251 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926253 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926255 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926258 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926260 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926263 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:25.931536 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926265 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926267 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926270 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926272 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926275 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926277 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926280 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926282 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926284 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926287 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926289 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926291 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926294 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926296 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926300 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926304 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926307 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926309 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926312 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:25.932031 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926314 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926318 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926321 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926323 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926327 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926329 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926332 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926334 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926337 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926339 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926341 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926344 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926346 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926349 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926351 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926353 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926356 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926358 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926361 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:25.932589 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926365 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926368 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926371 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926373 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926377 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926380 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926383 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926386 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926389 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926391 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926394 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926397 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926399 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926402 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926405 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926407 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926410 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926412 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926415 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:25.933054 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926417 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.926422 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926523 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926528 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926531 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926533 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926536 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926539 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926541 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926544 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926547 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926550 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926552 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926555 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926557 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:16:25.933498 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926560 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926562 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926565 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926567 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926569 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926572 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926574 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926576 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926579 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926581 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926583 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926587 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926591 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926594 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926597 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926600 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926602 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926605 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926608 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:16:25.933953 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926611 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926613 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926616 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926618 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926620 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926623 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926625 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926628 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926630 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926633 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926635 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926637 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926641 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926643 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926646 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926648 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926650 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926653 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926655 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926657 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:16:25.934499 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926660 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926662 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926665 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926667 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926670 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926672 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926675 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926677 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926679 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926682 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926684 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926687 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926689 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926691 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926694 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926696 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926699 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926701 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926703 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926706 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:16:25.935167 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926708 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926710 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926713 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926715 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926717 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926720 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926723 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926725 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926727 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926730 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926732 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926736 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926739 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926741 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926744 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926747 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926749 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926752 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926754 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:16:25.935684 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926757 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926759 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926761 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926764 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926766 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926769 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926771 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:25.926773 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.926778 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.926874 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.929431 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.930797 2558 server.go:1019] "Starting client certificate rotation" Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.930903 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:16:25.936158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.930936 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:16:25.936491 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.935663 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:16:25.940215 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.940197 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:16:25.949094 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.949079 2558 log.go:25] "Validated CRI v1 runtime API" Jul 08 18:16:25.951126 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.951113 2558 log.go:25] "Validated CRI v1 image API" Jul 08 18:16:25.951919 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.951898 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 18:16:25.954051 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.954030 2558 fs.go:135] Filesystem UUIDs: map[37388e9e-04a0-4322-9846-157d2731f591:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e6f8b74e-3e21-489d-a0df-47ba3dfa97c7:/dev/nvme0n1p4] Jul 08 18:16:25.954104 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.954051 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 18:16:25.958778 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.958684 2558 manager.go:216] Machine: {Timestamp:2026-07-08 18:16:25.958185272 +0000 UTC m=+0.295721113 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3205572 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29a048e6b7920921fd3d774bf13f5b SystemUUID:ec29a048-e6b7-9209-21fd-3d774bf13f5b BootID:1bd97632-2b8f-4e87-98ed-eb0ef8f41f6a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:7f:5f:f8:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:7f:5f:f8:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:ac:e4:79:bb:02 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 18:16:25.958778 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.958772 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 18:16:25.958892 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.958841 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 18:16:25.960915 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.960899 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:16:25.961708 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.961689 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 18:16:25.961850 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.961712 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-158.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 18:16:25.962506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.962495 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 18:16:25.962506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.962506 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 18:16:25.962584 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.962513 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:16:25.963177 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.963167 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:16:25.964575 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.964565 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 18:16:25.967944 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.967933 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:16:25.968047 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.968038 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 18:16:25.968083 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.968064 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 08 18:16:25.968693 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.968682 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 18:16:25.968746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.968715 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 18:16:25.968746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.968724 2558 kubelet.go:398] "Adding apiserver pod source" Jul 08 18:16:25.968746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.968731 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 18:16:25.969119 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.969108 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:16:25.969160 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.969125 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:16:25.974136 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.974116 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 18:16:25.976053 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.976039 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 18:16:25.976109 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.976068 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 18:16:25.977182 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977168 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 18:16:25.977182 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977184 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977193 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977201 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977209 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977214 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977221 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977226 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977232 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977238 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977246 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977254 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977282 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 18:16:25.977285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.977290 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 18:16:25.978946 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.978928 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-158.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 18:16:25.979468 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:25.979448 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 18:16:25.979525 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:25.979450 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 18:16:25.980236 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.980224 2558 server.go:1268] "Started kubelet" Jul 08 18:16:25.980360 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.980303 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 18:16:25.980423 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.980368 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 18:16:25.980423 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.980345 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 18:16:25.981002 ip-10-0-130-158 systemd[1]: Started Kubernetes Kubelet. Jul 08 18:16:25.983004 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.982992 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 08 18:16:25.983312 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.983287 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jkh76" Jul 08 18:16:25.984424 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.984409 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 18:16:25.985383 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:25.985364 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 18:16:25.989785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.989771 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 18:16:25.989785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.989779 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 18:16:25.989901 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:25.989838 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:25.990593 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990548 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 18:16:25.990593 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990553 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 18:16:25.990593 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990570 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 18:16:25.990785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990628 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 18:16:25.990785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990642 2558 factory.go:55] Registering systemd factory Jul 08 18:16:25.990785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990654 2558 factory.go:223] Registration of the systemd container factory successfully Jul 08 18:16:25.990785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990670 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 08 18:16:25.990785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990680 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 08 18:16:25.991011 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990915 2558 factory.go:153] Registering CRI-O factory Jul 08 18:16:25.991011 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990931 2558 factory.go:223] Registration of the crio container factory successfully Jul 08 18:16:25.991011 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990953 2558 factory.go:103] Registering Raw factory Jul 08 18:16:25.991011 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.990968 2558 manager.go:1196] Started watching for new ooms in manager Jul 08 18:16:25.992170 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.992155 2558 manager.go:349] Starting recovery of all containers Jul 08 18:16:25.992864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:25.992836 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jkh76" Jul 08 18:16:25.994653 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:25.994579 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 18:16:25.994729 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:25.994686 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-158.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 18:16:25.995705 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:25.994677 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-158.ec2.internal.18c06341a1f8cd0d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-158.ec2.internal,UID:ip-10-0-130-158.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-158.ec2.internal,},FirstTimestamp:2026-07-08 18:16:25.980177677 +0000 UTC m=+0.317713500,LastTimestamp:2026-07-08 18:16:25.980177677 +0000 UTC m=+0.317713500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-158.ec2.internal,}" Jul 08 18:16:27.600082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.599956 2558 manager.go:354] Recovery completed Jul 08 18:16:27.603788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.603775 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:27.606632 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.606617 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:27.606737 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.606644 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:27.606737 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.606655 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:27.607116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.607105 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 18:16:27.607116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.607115 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 18:16:27.607202 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.607123 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:27.607202 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.607130 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:16:27.607777 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.607762 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:27.607849 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.607791 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:27.607849 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.607804 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:27.608539 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.608527 2558 policy_none.go:49] "None policy: Start" Jul 08 18:16:27.608576 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.608542 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 18:16:27.608576 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.608553 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 18:16:27.609602 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.609591 2558 policy_none.go:47] "Start" Jul 08 18:16:27.641797 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.641784 2558 manager.go:337] "Starting Device Plugin manager" Jul 08 18:16:27.641852 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.641810 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 18:16:27.641852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.641819 2558 server.go:87] "Starting device plugin registration server" Jul 08 18:16:27.642019 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.642006 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 18:16:27.642059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.642022 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 18:16:27.642148 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.642127 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 18:16:27.642227 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.642213 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 18:16:27.642306 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.642223 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 18:16:27.642623 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.642601 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 18:16:27.642696 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.642647 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:27.721229 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.721204 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 18:16:27.722404 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.722392 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 18:16:27.722464 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.722436 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 18:16:27.722464 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.722453 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 18:16:27.722554 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.722486 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 18:16:27.724489 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.724475 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:27.742085 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.742068 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:27.743015 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.742997 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:27.743087 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.743027 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:27.743087 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.743037 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:27.743087 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.743056 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.748341 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.748326 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.748418 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.748344 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-158.ec2.internal\": node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:27.773928 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.773881 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:27.823572 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.823555 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal"] Jul 08 18:16:27.823640 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.823604 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:27.824304 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.824287 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:27.824373 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.824317 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:27.824373 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.824327 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:27.825665 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.825653 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:27.825785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.825771 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.825886 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.825799 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:27.827235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.826604 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:27.827235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.826628 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:27.827235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.826640 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:27.827235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.826915 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:27.827235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.826942 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:27.827235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.826955 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:27.828005 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.827986 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.828059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.828017 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:16:27.828699 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.828683 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:16:27.828778 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.828708 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:16:27.828778 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.828721 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:16:27.852879 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.852840 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-158.ec2.internal\" not found" node="ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.857172 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.857157 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-158.ec2.internal\" not found" node="ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.874132 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.874112 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:27.887835 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.887817 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/831e9ec52a3238957c7f1fb3d14b894f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-158.ec2.internal\" (UID: \"831e9ec52a3238957c7f1fb3d14b894f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.887925 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.887845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/556c0bc2b69d90a68099396d7b905ebb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"556c0bc2b69d90a68099396d7b905ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.887925 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.887871 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/556c0bc2b69d90a68099396d7b905ebb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"556c0bc2b69d90a68099396d7b905ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.974218 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:27.974195 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:27.988557 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.988531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/556c0bc2b69d90a68099396d7b905ebb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"556c0bc2b69d90a68099396d7b905ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.988615 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.988571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/556c0bc2b69d90a68099396d7b905ebb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"556c0bc2b69d90a68099396d7b905ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.988615 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.988587 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/831e9ec52a3238957c7f1fb3d14b894f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-158.ec2.internal\" (UID: \"831e9ec52a3238957c7f1fb3d14b894f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.988615 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.988588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/556c0bc2b69d90a68099396d7b905ebb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"556c0bc2b69d90a68099396d7b905ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.988615 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.988610 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/831e9ec52a3238957c7f1fb3d14b894f-config\") pod \"kube-apiserver-proxy-ip-10-0-130-158.ec2.internal\" (UID: \"831e9ec52a3238957c7f1fb3d14b894f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" Jul 08 18:16:27.988724 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:27.988634 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/556c0bc2b69d90a68099396d7b905ebb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal\" (UID: \"556c0bc2b69d90a68099396d7b905ebb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:28.074963 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.074921 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.156388 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.156367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:28.161098 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.161082 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" Jul 08 18:16:28.175958 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.175926 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.276457 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.276432 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.377022 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.377000 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.467968 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.467944 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:28.478002 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.477982 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.526429 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.526407 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 18:16:28.526891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.526515 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:16:28.526891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.526559 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:16:28.578834 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.578811 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.590129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.590104 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:11:27 +0000 UTC" deadline="2028-04-12 05:40:02.331500132 +0000 UTC" Jul 08 18:16:28.590129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.590127 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15443h23m33.741376187s" Jul 08 18:16:28.679019 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.678998 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.728755 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:28.728731 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831e9ec52a3238957c7f1fb3d14b894f.slice/crio-1ae91649aefd6b813f687bc90a9589ff042323fbc77791c39c64d67400a30b56 WatchSource:0}: Error finding container 1ae91649aefd6b813f687bc90a9589ff042323fbc77791c39c64d67400a30b56: Status 404 returned error can't find the container with id 1ae91649aefd6b813f687bc90a9589ff042323fbc77791c39c64d67400a30b56 Jul 08 18:16:28.728969 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:28.728946 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556c0bc2b69d90a68099396d7b905ebb.slice/crio-e7e8711451ab644e6b6d3c9a315fc802290146a02bc6ba254db61e01d7ddf4bf WatchSource:0}: Error finding container e7e8711451ab644e6b6d3c9a315fc802290146a02bc6ba254db61e01d7ddf4bf: Status 404 returned error can't find the container with id e7e8711451ab644e6b6d3c9a315fc802290146a02bc6ba254db61e01d7ddf4bf Jul 08 18:16:28.732820 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.732807 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:16:28.779781 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.779765 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.880360 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.880318 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:28.952034 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:28.952016 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:28.980830 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:28.980809 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:29.081667 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.081645 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-158.ec2.internal\" not found" Jul 08 18:16:29.135403 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.133708 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:29.185766 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.185744 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" Jul 08 18:16:29.200163 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.200142 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:16:29.201096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.201069 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" Jul 08 18:16:29.209520 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.209489 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:16:29.565848 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.565775 2558 apiserver.go:52] "Watching apiserver" Jul 08 18:16:29.573144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.573119 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 18:16:29.573580 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.573553 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-gswlg","kube-system/konnectivity-agent-99v7g","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps","openshift-dns/node-resolver-5mpwj","openshift-image-registry/node-ca-ppq4c","openshift-network-operator/iptables-alerter-q2b8r","openshift-ovn-kubernetes/ovnkube-node-7gb6c","kube-system/global-pull-secret-syncer-czbs4","kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal","openshift-cluster-node-tuning-operator/tuned-z9h4p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal","openshift-multus/multus-additional-cni-plugins-snkk7","openshift-multus/multus-jfw8c","openshift-multus/network-metrics-daemon-2gp9w"] Jul 08 18:16:29.575712 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.575694 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.577033 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.576963 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.578378 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.578249 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 18:16:29.578378 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.578355 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.578926 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.578899 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 18:16:29.579024 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.578957 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 18:16:29.579126 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579110 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 18:16:29.579196 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579173 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 18:16:29.579247 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579221 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 18:16:29.579391 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579245 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p2zt4\"" Jul 08 18:16:29.579672 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579605 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 18:16:29.579672 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579625 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 18:16:29.579672 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579635 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 18:16:29.579882 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579778 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 18:16:29.580030 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.579947 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4slbl\"" Jul 08 18:16:29.580985 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.580475 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 18:16:29.580985 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.580732 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7mvwc\"" Jul 08 18:16:29.580985 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.580481 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 18:16:29.581169 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.581110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.581537 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.581345 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 18:16:29.582096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.582078 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.583303 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.583284 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-42bvq\"" Jul 08 18:16:29.583394 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.583338 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 18:16:29.583556 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.583530 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.584105 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.584089 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 18:16:29.584183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.584093 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 18:16:29.584769 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.584461 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 18:16:29.584769 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.584525 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m22tp\"" Jul 08 18:16:29.584769 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.584646 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 18:16:29.584963 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.584908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:29.585014 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.584988 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:29.586007 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.585940 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 18:16:29.586007 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.585998 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:16:29.586148 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.586013 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 18:16:29.586714 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.586295 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 18:16:29.586714 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.586564 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qf2rs\"" Jul 08 18:16:29.586714 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.586598 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:29.586714 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.586646 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:29.589546 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.589527 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.591991 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.590435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.592425 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.592235 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.592509 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.592478 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:29.592570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.592513 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 18:16:29.592788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.592649 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vrxsc\"" Jul 08 18:16:29.593463 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.593228 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 18:16:29.593463 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.593400 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2np8g\"" Jul 08 18:16:29.593463 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.593228 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 18:16:29.593463 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.593440 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:16:29.594190 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.594169 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.596738 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.596593 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hbx49\"" Jul 08 18:16:29.596738 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.596604 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 18:16:29.597036 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.597016 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:16:29.597036 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.597024 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 18:16:29.598645 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-cni-netd\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.598761 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598658 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-kubelet\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.598761 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:29.598761 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-systemd-units\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.598924 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598804 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-log-socket\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.598924 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.598924 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598868 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqn9b\" (UniqueName: \"kubernetes.io/projected/5298fad9-38ff-472e-bace-ca742339abc9-kube-api-access-mqn9b\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:29.598924 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598893 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.598924 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-ovnkube-script-lib\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkwz7\" (UniqueName: \"kubernetes.io/projected/46421e6d-265d-4330-b97f-2e38e3e06161-kube-api-access-zkwz7\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598957 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-kubelet\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.598990 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-cni-binary-copy\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-daemon-config\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599042 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw8jn\" (UniqueName: \"kubernetes.io/projected/c109e437-2b60-4950-a1d7-5202e712213f-kube-api-access-pw8jn\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599090 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/987f7a45-3051-4fc6-a2d8-a611d88d2f90-tmp-dir\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599112 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjgmw\" (UniqueName: \"kubernetes.io/projected/71553acf-9924-4aba-8ab1-8add14967aa9-kube-api-access-zjgmw\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599134 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-node-log\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599174 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599155 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-cni-bin\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-ovnkube-config\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599210 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-k8s-cni-cncf-io\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-os-release\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599332 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-etc-kubernetes\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599356 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-serviceca\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-run-ovn-kubernetes\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-cni-multus\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599479 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxk9q\" (UniqueName: \"kubernetes.io/projected/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-kube-api-access-bxk9q\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-slash\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-registration-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-ovn\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.599675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-cni-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-hostroot\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599716 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-host\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71553acf-9924-4aba-8ab1-8add14967aa9-iptables-alerter-script\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-cni-bin\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrz8\" (UniqueName: \"kubernetes.io/projected/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-kube-api-access-lqrz8\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-device-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.599968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-etc-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600067 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-var-lib-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46421e6d-265d-4330-b97f-2e38e3e06161-ovn-node-metrics-cert\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-system-cni-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600184 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-cnibin\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-multus-certs\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600228 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkf8r\" (UniqueName: \"kubernetes.io/projected/987f7a45-3051-4fc6-a2d8-a611d88d2f90-kube-api-access-dkf8r\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71553acf-9924-4aba-8ab1-8add14967aa9-host-slash\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-run-netns\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.600428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-socket-dir-parent\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.601218 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-netns\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.601218 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-socket-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.601218 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-sys-fs\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.601218 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600381 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/987f7a45-3051-4fc6-a2d8-a611d88d2f90-hosts-file\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.601218 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-conf-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.601218 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600426 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-systemd\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.601218 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.600450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-env-overrides\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.620157 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.620076 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f2s4v" Jul 08 18:16:29.628819 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.628760 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f2s4v" Jul 08 18:16:29.687827 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.687802 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 18:16:29.700813 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700793 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysctl-d\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.700926 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-run\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.700926 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:29.700926 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700863 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-systemd-units\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.700926 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-log-socket\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700930 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqn9b\" (UniqueName: \"kubernetes.io/projected/5298fad9-38ff-472e-bace-ca742339abc9-kube-api-access-mqn9b\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.700994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-os-release\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701072 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-ovnkube-script-lib\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkwz7\" (UniqueName: \"kubernetes.io/projected/46421e6d-265d-4330-b97f-2e38e3e06161-kube-api-access-zkwz7\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701459 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701163 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cnibin\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.701459 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701234 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701459 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfznj\" (UniqueName: \"kubernetes.io/projected/10bbd63f-5cbb-4006-a3c7-9255b25420e5-kube-api-access-hfznj\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.701459 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-log-socket\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701459 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-systemd-units\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701459 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701365 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-etc-selinux\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-kubelet\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701514 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-cni-binary-copy\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-daemon-config\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701545 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-kubelet\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysconfig\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1791bcc8-0ed7-44e5-97b4-ab22545e3268-tmp\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.701735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw8jn\" (UniqueName: \"kubernetes.io/projected/c109e437-2b60-4950-a1d7-5202e712213f-kube-api-access-pw8jn\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701827 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/987f7a45-3051-4fc6-a2d8-a611d88d2f90-tmp-dir\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701889 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjgmw\" (UniqueName: \"kubernetes.io/projected/71553acf-9924-4aba-8ab1-8add14967aa9-kube-api-access-zjgmw\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-node-log\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701942 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-cni-bin\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-ovnkube-config\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.701993 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-k8s-cni-cncf-io\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-ovnkube-script-lib\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702100 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702051 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702121 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-daemon-config\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-os-release\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702135 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-cni-bin\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702170 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-etc-kubernetes\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702174 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-k8s-cni-cncf-io\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-serviceca\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-os-release\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702221 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4956326e-d875-4102-b4f8-11ad7a3208c4-konnectivity-ca\") pod \"konnectivity-agent-99v7g\" (UID: \"4956326e-d875-4102-b4f8-11ad7a3208c4\") " pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702242 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/987f7a45-3051-4fc6-a2d8-a611d88d2f90-tmp-dir\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-lib-modules\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702330 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-cni-binary-copy\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702341 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-etc-kubernetes\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.702398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702378 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-run-ovn-kubernetes\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702409 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-cni-multus\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702412 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-node-log\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxk9q\" (UniqueName: \"kubernetes.io/projected/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-kube-api-access-bxk9q\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702570 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-cni-multus\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702643 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-run-ovn-kubernetes\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.702842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-serviceca\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-kubernetes\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-ovnkube-config\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703060 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-systemd\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-slash\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703109 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-registration-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1157d0fd-f7be-4fea-bfa0-4212d2a77315-kubelet-config\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.703183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-ovn\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703198 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-cni-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-slash\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-hostroot\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-registration-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-ovn\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-host\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-cni-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-hostroot\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703335 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-host\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71553acf-9924-4aba-8ab1-8add14967aa9-iptables-alerter-script\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-cni-bin\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrz8\" (UniqueName: \"kubernetes.io/projected/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-kube-api-access-lqrz8\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-device-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-etc-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703517 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-cni-bin\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:29.703786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxm7\" (UniqueName: \"kubernetes.io/projected/1791bcc8-0ed7-44e5-97b4-ab22545e3268-kube-api-access-7nxm7\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703613 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-var-lib-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46421e6d-265d-4330-b97f-2e38e3e06161-ovn-node-metrics-cert\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.703652 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-system-cni-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.703723 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:30.203692966 +0000 UTC m=+2.945761511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-cnibin\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-system-cni-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703772 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-var-lib-kubelet\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703811 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-var-lib-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-system-cni-dir\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703848 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-multus-certs\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703909 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkf8r\" (UniqueName: \"kubernetes.io/projected/987f7a45-3051-4fc6-a2d8-a611d88d2f90-kube-api-access-dkf8r\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71553acf-9924-4aba-8ab1-8add14967aa9-host-slash\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-run-netns\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.703992 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71553acf-9924-4aba-8ab1-8add14967aa9-iptables-alerter-script\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-socket-dir-parent\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.704733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-multus-certs\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-cnibin\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysctl-conf\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704072 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71553acf-9924-4aba-8ab1-8add14967aa9-host-slash\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704097 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-netns\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704103 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-etc-openvswitch\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704151 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-device-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704175 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704206 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-socket-dir-parent\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-socket-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704261 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-run-netns\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704322 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-run-netns\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-sys-fs\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/987f7a45-3051-4fc6-a2d8-a611d88d2f90-hosts-file\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704407 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-socket-dir\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704431 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c109e437-2b60-4950-a1d7-5202e712213f-sys-fs\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704457 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-host\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-tuned\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.705414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704505 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-conf-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-modprobe-d\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704522 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/987f7a45-3051-4fc6-a2d8-a611d88d2f90-hosts-file\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-systemd\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704596 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-multus-conf-dir\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704585 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-env-overrides\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704641 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-run-systemd\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704667 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4956326e-d875-4102-b4f8-11ad7a3208c4-agent-certs\") pod \"konnectivity-agent-99v7g\" (UID: \"4956326e-d875-4102-b4f8-11ad7a3208c4\") " pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-sys\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-cni-netd\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-kubelet\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1157d0fd-f7be-4fea-bfa0-4212d2a77315-dbus\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704750 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46421e6d-265d-4330-b97f-2e38e3e06161-host-cni-netd\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704827 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-host-var-lib-kubelet\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.706224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.704975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46421e6d-265d-4330-b97f-2e38e3e06161-env-overrides\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.706980 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.706794 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:29.706980 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.706815 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:29.706980 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.706840 2558 projected.go:196] Error preparing data for projected volume kube-api-access-8x9bf for pod openshift-network-diagnostics/network-check-target-gswlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:29.706980 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.706900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf podName:9a8fce54-d32f-48bb-a2c7-f0d30dc08956 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:30.2068716 +0000 UTC m=+2.948940145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8x9bf" (UniqueName: "kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf") pod "network-check-target-gswlg" (UID: "9a8fce54-d32f-48bb-a2c7-f0d30dc08956") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:29.708131 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.708109 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46421e6d-265d-4330-b97f-2e38e3e06161-ovn-node-metrics-cert\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.710447 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.710428 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqn9b\" (UniqueName: \"kubernetes.io/projected/5298fad9-38ff-472e-bace-ca742339abc9-kube-api-access-mqn9b\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:29.710559 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.710530 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjgmw\" (UniqueName: \"kubernetes.io/projected/71553acf-9924-4aba-8ab1-8add14967aa9-kube-api-access-zjgmw\") pod \"iptables-alerter-q2b8r\" (UID: \"71553acf-9924-4aba-8ab1-8add14967aa9\") " pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.713417 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.712843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkwz7\" (UniqueName: \"kubernetes.io/projected/46421e6d-265d-4330-b97f-2e38e3e06161-kube-api-access-zkwz7\") pod \"ovnkube-node-7gb6c\" (UID: \"46421e6d-265d-4330-b97f-2e38e3e06161\") " pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.713417 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.713251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw8jn\" (UniqueName: \"kubernetes.io/projected/c109e437-2b60-4950-a1d7-5202e712213f-kube-api-access-pw8jn\") pod \"aws-ebs-csi-driver-node-rcmps\" (UID: \"c109e437-2b60-4950-a1d7-5202e712213f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.714673 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.714604 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxk9q\" (UniqueName: \"kubernetes.io/projected/a299dc5d-5fb2-4c2b-bd27-5c730b36f679-kube-api-access-bxk9q\") pod \"node-ca-ppq4c\" (UID: \"a299dc5d-5fb2-4c2b-bd27-5c730b36f679\") " pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.721075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.721037 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrz8\" (UniqueName: \"kubernetes.io/projected/0f32314b-f5ce-49e4-bb3e-f2dc956274f6-kube-api-access-lqrz8\") pod \"multus-jfw8c\" (UID: \"0f32314b-f5ce-49e4-bb3e-f2dc956274f6\") " pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.722346 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.722325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkf8r\" (UniqueName: \"kubernetes.io/projected/987f7a45-3051-4fc6-a2d8-a611d88d2f90-kube-api-access-dkf8r\") pod \"node-resolver-5mpwj\" (UID: \"987f7a45-3051-4fc6-a2d8-a611d88d2f90\") " pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.728019 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.727938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" event={"ID":"831e9ec52a3238957c7f1fb3d14b894f","Type":"ContainerStarted","Data":"1ae91649aefd6b813f687bc90a9589ff042323fbc77791c39c64d67400a30b56"} Jul 08 18:16:29.729142 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.729120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" event={"ID":"556c0bc2b69d90a68099396d7b905ebb","Type":"ContainerStarted","Data":"e7e8711451ab644e6b6d3c9a315fc802290146a02bc6ba254db61e01d7ddf4bf"} Jul 08 18:16:29.805195 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-host\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805195 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-tuned\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-modprobe-d\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805228 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4956326e-d875-4102-b4f8-11ad7a3208c4-agent-certs\") pod \"konnectivity-agent-99v7g\" (UID: \"4956326e-d875-4102-b4f8-11ad7a3208c4\") " pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-sys\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-sys\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1157d0fd-f7be-4fea-bfa0-4212d2a77315-dbus\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-host\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805373 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-modprobe-d\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysctl-d\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805426 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-run\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805495 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-os-release\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805522 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysctl-d\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805470 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1157d0fd-f7be-4fea-bfa0-4212d2a77315-dbus\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cnibin\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-run\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.805555 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:29.805751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805579 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-os-release\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cnibin\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805580 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfznj\" (UniqueName: \"kubernetes.io/projected/10bbd63f-5cbb-4006-a3c7-9255b25420e5-kube-api-access-hfznj\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:29.805625 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret podName:1157d0fd-f7be-4fea-bfa0-4212d2a77315 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:30.305607475 +0000 UTC m=+3.047676003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret") pod "global-pull-secret-syncer-czbs4" (UID: "1157d0fd-f7be-4fea-bfa0-4212d2a77315") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysconfig\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1791bcc8-0ed7-44e5-97b4-ab22545e3268-tmp\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysconfig\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4956326e-d875-4102-b4f8-11ad7a3208c4-konnectivity-ca\") pod \"konnectivity-agent-99v7g\" (UID: \"4956326e-d875-4102-b4f8-11ad7a3208c4\") " pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-lib-modules\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-kubernetes\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-systemd\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805967 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1157d0fd-f7be-4fea-bfa0-4212d2a77315-kubelet-config\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.805992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.806570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806194 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806339 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-lib-modules\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806356 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-systemd\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1157d0fd-f7be-4fea-bfa0-4212d2a77315-kubelet-config\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806401 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-kubernetes\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxm7\" (UniqueName: \"kubernetes.io/projected/1791bcc8-0ed7-44e5-97b4-ab22545e3268-kube-api-access-7nxm7\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-var-lib-kubelet\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806495 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-system-cni-dir\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/10bbd63f-5cbb-4006-a3c7-9255b25420e5-cni-binary-copy\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806522 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysctl-conf\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806584 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/10bbd63f-5cbb-4006-a3c7-9255b25420e5-system-cni-dir\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-var-lib-kubelet\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-sysctl-conf\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.807415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.806735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4956326e-d875-4102-b4f8-11ad7a3208c4-konnectivity-ca\") pod \"konnectivity-agent-99v7g\" (UID: \"4956326e-d875-4102-b4f8-11ad7a3208c4\") " pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.808084 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.807893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4956326e-d875-4102-b4f8-11ad7a3208c4-agent-certs\") pod \"konnectivity-agent-99v7g\" (UID: \"4956326e-d875-4102-b4f8-11ad7a3208c4\") " pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.808207 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.808181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1791bcc8-0ed7-44e5-97b4-ab22545e3268-etc-tuned\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.808629 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.808604 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1791bcc8-0ed7-44e5-97b4-ab22545e3268-tmp\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.814046 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.814017 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfznj\" (UniqueName: \"kubernetes.io/projected/10bbd63f-5cbb-4006-a3c7-9255b25420e5-kube-api-access-hfznj\") pod \"multus-additional-cni-plugins-snkk7\" (UID: \"10bbd63f-5cbb-4006-a3c7-9255b25420e5\") " pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:29.814345 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.814323 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxm7\" (UniqueName: \"kubernetes.io/projected/1791bcc8-0ed7-44e5-97b4-ab22545e3268-kube-api-access-7nxm7\") pod \"tuned-z9h4p\" (UID: \"1791bcc8-0ed7-44e5-97b4-ab22545e3268\") " pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.890337 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.890314 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:29.897115 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.897091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jfw8c" Jul 08 18:16:29.907025 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.906975 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" Jul 08 18:16:29.914805 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.914789 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mpwj" Jul 08 18:16:29.926335 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.926316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ppq4c" Jul 08 18:16:29.933731 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.933715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q2b8r" Jul 08 18:16:29.940345 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.940327 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:29.947708 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.947690 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" Jul 08 18:16:29.954419 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:29.954403 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-snkk7" Jul 08 18:16:30.050333 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.050307 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:30.209773 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.209702 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:30.209895 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.209774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:30.209895 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.209870 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:30.209895 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.209873 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:30.209895 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.209895 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:30.210063 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.209907 2558 projected.go:196] Error preparing data for projected volume kube-api-access-8x9bf for pod openshift-network-diagnostics/network-check-target-gswlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:30.210063 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.209952 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:31.209911998 +0000 UTC m=+3.951980526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:30.210063 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.209967 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf podName:9a8fce54-d32f-48bb-a2c7-f0d30dc08956 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:31.20996045 +0000 UTC m=+3.952028978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x9bf" (UniqueName: "kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf") pod "network-check-target-gswlg" (UID: "9a8fce54-d32f-48bb-a2c7-f0d30dc08956") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:30.310876 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.310846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:30.311025 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.311004 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:30.311082 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:30.311064 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret podName:1157d0fd-f7be-4fea-bfa0-4212d2a77315 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:31.311045455 +0000 UTC m=+4.053113984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret") pod "global-pull-secret-syncer-czbs4" (UID: "1157d0fd-f7be-4fea-bfa0-4212d2a77315") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:30.565403 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.565383 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:16:30.574153 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.574125 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod987f7a45_3051_4fc6_a2d8_a611d88d2f90.slice/crio-35ad10ab823b31be763dc540aaf47531f443d8284ee628a3aa0b08fdb0606fa4 WatchSource:0}: Error finding container 35ad10ab823b31be763dc540aaf47531f443d8284ee628a3aa0b08fdb0606fa4: Status 404 returned error can't find the container with id 35ad10ab823b31be763dc540aaf47531f443d8284ee628a3aa0b08fdb0606fa4 Jul 08 18:16:30.575985 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.575959 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1791bcc8_0ed7_44e5_97b4_ab22545e3268.slice/crio-a9b7651f7f80006c41e32dd990f5966e89f006d147389a5046fca31dc2220cb3 WatchSource:0}: Error finding container a9b7651f7f80006c41e32dd990f5966e89f006d147389a5046fca31dc2220cb3: Status 404 returned error can't find the container with id a9b7651f7f80006c41e32dd990f5966e89f006d147389a5046fca31dc2220cb3 Jul 08 18:16:30.579581 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.579555 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bbd63f_5cbb_4006_a3c7_9255b25420e5.slice/crio-d7f4328d8dfa2c30e63dd5494f6bf61726fafbf35f45f7b4cb5424a917fb5569 WatchSource:0}: Error finding container d7f4328d8dfa2c30e63dd5494f6bf61726fafbf35f45f7b4cb5424a917fb5569: Status 404 returned error can't find the container with id d7f4328d8dfa2c30e63dd5494f6bf61726fafbf35f45f7b4cb5424a917fb5569 Jul 08 18:16:30.580396 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.580375 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda299dc5d_5fb2_4c2b_bd27_5c730b36f679.slice/crio-a5c078b62eb8a7b4bc0cbe732fad044d4efe37e55d898b4686e667cde5c9ff9f WatchSource:0}: Error finding container a5c078b62eb8a7b4bc0cbe732fad044d4efe37e55d898b4686e667cde5c9ff9f: Status 404 returned error can't find the container with id a5c078b62eb8a7b4bc0cbe732fad044d4efe37e55d898b4686e667cde5c9ff9f Jul 08 18:16:30.580914 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.580894 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4956326e_d875_4102_b4f8_11ad7a3208c4.slice/crio-50af6665003b8847019147ed258fb0b684ccbf688c189b9d0603268e3d5ae41a WatchSource:0}: Error finding container 50af6665003b8847019147ed258fb0b684ccbf688c189b9d0603268e3d5ae41a: Status 404 returned error can't find the container with id 50af6665003b8847019147ed258fb0b684ccbf688c189b9d0603268e3d5ae41a Jul 08 18:16:30.582252 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.582227 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc109e437_2b60_4950_a1d7_5202e712213f.slice/crio-78094f493844d97dfbe690549cf60639d0d9fe422b653f5accc8a61cf8c209bc WatchSource:0}: Error finding container 78094f493844d97dfbe690549cf60639d0d9fe422b653f5accc8a61cf8c209bc: Status 404 returned error can't find the container with id 78094f493844d97dfbe690549cf60639d0d9fe422b653f5accc8a61cf8c209bc Jul 08 18:16:30.582994 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.582834 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f32314b_f5ce_49e4_bb3e_f2dc956274f6.slice/crio-770804a058761891259de6c31956425c8bc4172aa4f0322a9bdda534541d66a2 WatchSource:0}: Error finding container 770804a058761891259de6c31956425c8bc4172aa4f0322a9bdda534541d66a2: Status 404 returned error can't find the container with id 770804a058761891259de6c31956425c8bc4172aa4f0322a9bdda534541d66a2 Jul 08 18:16:30.585152 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.585129 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46421e6d_265d_4330_b97f_2e38e3e06161.slice/crio-524f760969dd957b66d15d2f45ec085e1ac29c657c608229f7719bc58dd361e3 WatchSource:0}: Error finding container 524f760969dd957b66d15d2f45ec085e1ac29c657c608229f7719bc58dd361e3: Status 404 returned error can't find the container with id 524f760969dd957b66d15d2f45ec085e1ac29c657c608229f7719bc58dd361e3 Jul 08 18:16:30.586440 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:16:30.586412 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71553acf_9924_4aba_8ab1_8add14967aa9.slice/crio-a92764e42a74ca0aac2640574e5577526e8c52391ad21381288409a370b31ff8 WatchSource:0}: Error finding container a92764e42a74ca0aac2640574e5577526e8c52391ad21381288409a370b31ff8: Status 404 returned error can't find the container with id a92764e42a74ca0aac2640574e5577526e8c52391ad21381288409a370b31ff8 Jul 08 18:16:30.631573 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.631396 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:11:29 +0000 UTC" deadline="2028-02-01 13:41:49.089106596 +0000 UTC" Jul 08 18:16:30.631573 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.631573 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13747h25m18.457536714s" Jul 08 18:16:30.732439 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.732410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" event={"ID":"831e9ec52a3238957c7f1fb3d14b894f","Type":"ContainerStarted","Data":"38fb8fbcdfaeeb4a77d77e5042de16acdb1aecbbf62b5cf8240cda521887537e"} Jul 08 18:16:30.733754 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.733730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"524f760969dd957b66d15d2f45ec085e1ac29c657c608229f7719bc58dd361e3"} Jul 08 18:16:30.734967 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.734944 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jfw8c" event={"ID":"0f32314b-f5ce-49e4-bb3e-f2dc956274f6","Type":"ContainerStarted","Data":"770804a058761891259de6c31956425c8bc4172aa4f0322a9bdda534541d66a2"} Jul 08 18:16:30.736132 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.736098 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ppq4c" event={"ID":"a299dc5d-5fb2-4c2b-bd27-5c730b36f679","Type":"ContainerStarted","Data":"a5c078b62eb8a7b4bc0cbe732fad044d4efe37e55d898b4686e667cde5c9ff9f"} Jul 08 18:16:30.737305 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.737266 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerStarted","Data":"d7f4328d8dfa2c30e63dd5494f6bf61726fafbf35f45f7b4cb5424a917fb5569"} Jul 08 18:16:30.738349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.738325 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" event={"ID":"1791bcc8-0ed7-44e5-97b4-ab22545e3268","Type":"ContainerStarted","Data":"a9b7651f7f80006c41e32dd990f5966e89f006d147389a5046fca31dc2220cb3"} Jul 08 18:16:30.739612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.739556 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2b8r" event={"ID":"71553acf-9924-4aba-8ab1-8add14967aa9","Type":"ContainerStarted","Data":"a92764e42a74ca0aac2640574e5577526e8c52391ad21381288409a370b31ff8"} Jul 08 18:16:30.740649 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.740631 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" event={"ID":"c109e437-2b60-4950-a1d7-5202e712213f","Type":"ContainerStarted","Data":"78094f493844d97dfbe690549cf60639d0d9fe422b653f5accc8a61cf8c209bc"} Jul 08 18:16:30.741584 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.741566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-99v7g" event={"ID":"4956326e-d875-4102-b4f8-11ad7a3208c4","Type":"ContainerStarted","Data":"50af6665003b8847019147ed258fb0b684ccbf688c189b9d0603268e3d5ae41a"} Jul 08 18:16:30.742691 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.742672 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mpwj" event={"ID":"987f7a45-3051-4fc6-a2d8-a611d88d2f90","Type":"ContainerStarted","Data":"35ad10ab823b31be763dc540aaf47531f443d8284ee628a3aa0b08fdb0606fa4"} Jul 08 18:16:30.747909 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:30.747874 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-158.ec2.internal" podStartSLOduration=1.7478624699999998 podStartE2EDuration="1.74786247s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:30.747720922 +0000 UTC m=+3.489789471" watchObservedRunningTime="2026-07-08 18:16:30.74786247 +0000 UTC m=+3.489931020" Jul 08 18:16:31.217045 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.217017 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:31.217045 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.217077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:31.217345 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.217181 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:31.217345 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.217227 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:31.217345 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.217245 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:31.217345 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.217249 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:33.217229962 +0000 UTC m=+5.959298506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:31.217345 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.217258 2558 projected.go:196] Error preparing data for projected volume kube-api-access-8x9bf for pod openshift-network-diagnostics/network-check-target-gswlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:31.217345 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.217324 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf podName:9a8fce54-d32f-48bb-a2c7-f0d30dc08956 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:33.217308692 +0000 UTC m=+5.959377236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x9bf" (UniqueName: "kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf") pod "network-check-target-gswlg" (UID: "9a8fce54-d32f-48bb-a2c7-f0d30dc08956") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:31.318056 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.318020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:31.318194 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.318155 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:31.318306 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.318210 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret podName:1157d0fd-f7be-4fea-bfa0-4212d2a77315 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:33.318192321 +0000 UTC m=+6.060260863 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret") pod "global-pull-secret-syncer-czbs4" (UID: "1157d0fd-f7be-4fea-bfa0-4212d2a77315") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:31.631878 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.631810 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:11:29 +0000 UTC" deadline="2028-03-02 09:37:29.390957443 +0000 UTC" Jul 08 18:16:31.631878 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.631852 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14463h20m57.759110303s" Jul 08 18:16:31.727971 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.727318 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:31.727971 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.727462 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:31.727971 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.727842 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:31.727971 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.727927 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:31.728514 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.728366 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:31.728514 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:31.728457 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:31.757895 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.756950 2558 generic.go:356] "Generic (PLEG): container finished" podID="556c0bc2b69d90a68099396d7b905ebb" containerID="1828d724b6cb020eab4a0f91259888199cdb705aac649288483d5b41c6f87d96" exitCode=0 Jul 08 18:16:31.757895 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:31.757733 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" event={"ID":"556c0bc2b69d90a68099396d7b905ebb","Type":"ContainerDied","Data":"1828d724b6cb020eab4a0f91259888199cdb705aac649288483d5b41c6f87d96"} Jul 08 18:16:32.779757 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:32.779722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" event={"ID":"556c0bc2b69d90a68099396d7b905ebb","Type":"ContainerStarted","Data":"c0e213d4c509e4192e8d5c0724acaeb9bf3b06ea2c97195418a5970fac547e78"} Jul 08 18:16:33.236110 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:33.236075 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:33.236364 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:33.236162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:33.236364 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.236296 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:33.236364 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.236350 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:37.236331874 +0000 UTC m=+9.978400418 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:33.236570 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.236433 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:33.236570 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.236447 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:33.236570 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.236459 2558 projected.go:196] Error preparing data for projected volume kube-api-access-8x9bf for pod openshift-network-diagnostics/network-check-target-gswlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:33.236570 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.236493 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf podName:9a8fce54-d32f-48bb-a2c7-f0d30dc08956 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:37.236480977 +0000 UTC m=+9.978549523 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x9bf" (UniqueName: "kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf") pod "network-check-target-gswlg" (UID: "9a8fce54-d32f-48bb-a2c7-f0d30dc08956") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:33.337719 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:33.337182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:33.337719 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.337361 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:33.337719 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.337421 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret podName:1157d0fd-f7be-4fea-bfa0-4212d2a77315 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:37.337403251 +0000 UTC m=+10.079471802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret") pod "global-pull-secret-syncer-czbs4" (UID: "1157d0fd-f7be-4fea-bfa0-4212d2a77315") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:33.723298 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:33.723236 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:33.723298 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:33.723260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:33.723525 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.723392 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:33.723870 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.723681 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:33.723870 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:33.723764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:33.723870 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:33.723841 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:35.723809 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:35.723074 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:35.723809 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:35.723215 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:35.723809 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:35.723653 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:35.723809 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:35.723761 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:35.724686 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:35.724547 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:35.724686 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:35.724649 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:37.268077 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:37.268042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:37.268540 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:37.268213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:37.268540 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.268225 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:37.268540 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.268249 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:37.268540 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.268262 2558 projected.go:196] Error preparing data for projected volume kube-api-access-8x9bf for pod openshift-network-diagnostics/network-check-target-gswlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:37.268540 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.268330 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf podName:9a8fce54-d32f-48bb-a2c7-f0d30dc08956 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:45.268310784 +0000 UTC m=+18.010379328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x9bf" (UniqueName: "kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf") pod "network-check-target-gswlg" (UID: "9a8fce54-d32f-48bb-a2c7-f0d30dc08956") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:37.268540 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.268364 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:37.268540 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.268413 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:45.268397687 +0000 UTC m=+18.010466220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:37.369512 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:37.369479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:37.369651 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.369627 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:37.369721 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.369692 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret podName:1157d0fd-f7be-4fea-bfa0-4212d2a77315 nodeName:}" failed. No retries permitted until 2026-07-08 18:16:45.369675506 +0000 UTC m=+18.111744049 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret") pod "global-pull-secret-syncer-czbs4" (UID: "1157d0fd-f7be-4fea-bfa0-4212d2a77315") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:37.723750 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:37.723716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:37.723889 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:37.723829 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:37.723889 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.723839 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:37.724001 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.723948 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:37.724035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:37.724008 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:37.724095 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:37.724078 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:39.722888 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:39.722858 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:39.723354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:39.722858 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:39.723354 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:39.723005 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:39.723354 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:39.723089 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:39.723354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:39.723115 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:39.723354 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:39.723254 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:40.795676 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.795440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" event={"ID":"c109e437-2b60-4950-a1d7-5202e712213f","Type":"ContainerStarted","Data":"5920844aeb8f66111b16f21a181524d5d23047d81c01e64a3af6a1eed85cd461"} Jul 08 18:16:40.797557 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.797526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-99v7g" event={"ID":"4956326e-d875-4102-b4f8-11ad7a3208c4","Type":"ContainerStarted","Data":"1b2b134d086e9edc1d8a82b76dad202f713c0188afd398fb23f49703b669eaa9"} Jul 08 18:16:40.799612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.799583 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mpwj" event={"ID":"987f7a45-3051-4fc6-a2d8-a611d88d2f90","Type":"ContainerStarted","Data":"9627c1b7b35ccd04694209e27770d7d8020ad245ad45bc80f2f1fba441c90d45"} Jul 08 18:16:40.801377 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.801351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ppq4c" event={"ID":"a299dc5d-5fb2-4c2b-bd27-5c730b36f679","Type":"ContainerStarted","Data":"6aac6e89544c770bdd60de5c1b78ce9aaa9358d5d7c4de169036cb2a5e768bbf"} Jul 08 18:16:40.803316 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.803232 2558 generic.go:356] "Generic (PLEG): container finished" podID="10bbd63f-5cbb-4006-a3c7-9255b25420e5" containerID="f08aed81f8b0f7c037869caa878a93f5ab7c7ec837e2f3f48e1a502624ac9e03" exitCode=0 Jul 08 18:16:40.803416 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.803328 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerDied","Data":"f08aed81f8b0f7c037869caa878a93f5ab7c7ec837e2f3f48e1a502624ac9e03"} Jul 08 18:16:40.807153 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.807126 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" event={"ID":"1791bcc8-0ed7-44e5-97b4-ab22545e3268","Type":"ContainerStarted","Data":"2ee4c8364369750d150e20cc0f1266a889c81476c629ac6ca68d5f7fbe6bd07e"} Jul 08 18:16:40.811177 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.811133 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-158.ec2.internal" podStartSLOduration=11.811117795 podStartE2EDuration="11.811117795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:32.796759332 +0000 UTC m=+5.538827885" watchObservedRunningTime="2026-07-08 18:16:40.811117795 +0000 UTC m=+13.553186349" Jul 08 18:16:40.811601 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.811568 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-99v7g" podStartSLOduration=4.584996606 podStartE2EDuration="13.811556462s" totalImagesPullingTime="9.226559856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:40.810720772 +0000 UTC m=+13.552789324" watchObservedRunningTime="2026-07-08 18:16:40.811556462 +0000 UTC m=+13.553625014" Jul 08 18:16:40.856914 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.856672 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z9h4p" podStartSLOduration=4.569183233 podStartE2EDuration="13.856659204s" totalImagesPullingTime="9.287475971s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:40.85645321 +0000 UTC m=+13.598521755" watchObservedRunningTime="2026-07-08 18:16:40.856659204 +0000 UTC m=+13.598727749" Jul 08 18:16:40.857230 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.857191 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ppq4c" podStartSLOduration=4.629423786 podStartE2EDuration="13.857178165s" totalImagesPullingTime="9.227754379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:40.84246506 +0000 UTC m=+13.584533610" watchObservedRunningTime="2026-07-08 18:16:40.857178165 +0000 UTC m=+13.599246714" Jul 08 18:16:40.872856 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:40.872829 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5mpwj" podStartSLOduration=4.609542628 podStartE2EDuration="13.872818235s" totalImagesPullingTime="9.263275607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:40.872466818 +0000 UTC m=+13.614535368" watchObservedRunningTime="2026-07-08 18:16:40.872818235 +0000 UTC m=+13.614886785" Jul 08 18:16:41.413193 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.413170 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 18:16:41.650101 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.649945 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:16:41.413188828Z","UUID":"c5e90cba-ec35-4da0-8cd4-e5b8b77c612d","Handler":null,"Name":"","Endpoint":""} Jul 08 18:16:41.651770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.651751 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 18:16:41.651885 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.651792 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 18:16:41.723059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.723030 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:41.723164 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.723036 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:41.723164 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:41.723138 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:41.723266 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:41.723203 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:41.723266 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.723209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:41.723404 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:41.723311 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:41.810627 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.810603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" event={"ID":"c109e437-2b60-4950-a1d7-5202e712213f","Type":"ContainerStarted","Data":"138119749bac57667cf22109e7880288db43ac298ebe86e0b43e475f174c202e"} Jul 08 18:16:41.811862 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.811837 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q2b8r" event={"ID":"71553acf-9924-4aba-8ab1-8add14967aa9","Type":"ContainerStarted","Data":"117d145a24470d8806399dd7c5c6232a92e7166837af8bb0521ea80c4250ce18"} Jul 08 18:16:41.827234 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:41.827184 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q2b8r" podStartSLOduration=5.603862704 podStartE2EDuration="14.827166518s" totalImagesPullingTime="9.223303814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:41.826910649 +0000 UTC m=+14.568979227" watchObservedRunningTime="2026-07-08 18:16:41.827166518 +0000 UTC m=+14.569235071" Jul 08 18:16:43.723083 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:43.723039 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:43.723677 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:43.723151 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:43.723677 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:43.723176 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:43.723677 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:43.723235 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:43.723677 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:43.723338 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:43.723677 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:43.723424 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:44.470067 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:44.469833 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:44.470655 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:44.470632 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:45.333347 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:45.333317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:45.333765 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:45.333402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:45.333765 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.333492 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:45.333765 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.333499 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:16:45.333765 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.333525 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:16:45.333765 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.333540 2558 projected.go:196] Error preparing data for projected volume kube-api-access-8x9bf for pod openshift-network-diagnostics/network-check-target-gswlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:45.333765 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.333552 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:01.333532677 +0000 UTC m=+34.075601232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:16:45.333765 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.333591 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf podName:9a8fce54-d32f-48bb-a2c7-f0d30dc08956 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:01.333575408 +0000 UTC m=+34.075643943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x9bf" (UniqueName: "kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf") pod "network-check-target-gswlg" (UID: "9a8fce54-d32f-48bb-a2c7-f0d30dc08956") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:16:45.433675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:45.433645 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:45.433814 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.433773 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:45.433874 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.433830 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret podName:1157d0fd-f7be-4fea-bfa0-4212d2a77315 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:01.433814624 +0000 UTC m=+34.175883168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret") pod "global-pull-secret-syncer-czbs4" (UID: "1157d0fd-f7be-4fea-bfa0-4212d2a77315") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:16:45.723251 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:45.723108 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:45.723436 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.723251 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:45.723436 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:45.723240 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:45.723436 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:45.723312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:45.723436 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.723391 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:45.723592 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:45.723471 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:47.726492 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:47.726462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:47.726936 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:47.726462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:47.726936 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:47.726573 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:47.726936 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:47.726462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:47.726936 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:47.726640 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:47.726936 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:47.726733 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:49.727843 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:49.727811 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:49.728423 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:49.727920 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:49.728423 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:49.727929 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:49.728423 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:49.727928 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:49.728423 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:49.728029 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:49.728423 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:49.728082 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:50.866394 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:50.866361 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:50.866889 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:50.866499 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 18:16:50.867064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:50.867050 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-99v7g" Jul 08 18:16:51.726420 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:51.726390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:51.726582 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:51.726492 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:51.726582 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:51.726506 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:51.726684 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:51.726582 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:51.726684 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:51.726631 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:51.726755 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:51.726702 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:52.858219 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:52.858162 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jfw8c" podStartSLOduration=3.915961478 podStartE2EDuration="25.858141568s" totalImagesPullingTime="21.94218009s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:52.857348693 +0000 UTC m=+25.599417272" watchObservedRunningTime="2026-07-08 18:16:52.858141568 +0000 UTC m=+25.600210120" Jul 08 18:16:53.723780 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.723618 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:53.724022 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.723625 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:53.724022 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:53.723854 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:53.724022 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.723618 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:53.724022 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:53.723928 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:53.724022 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:53.723997 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:53.841602 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.841573 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" event={"ID":"c109e437-2b60-4950-a1d7-5202e712213f","Type":"ContainerStarted","Data":"724c390da88a22bcaca2e3011aac127eff7020468397eb7b845a058c12224eab"} Jul 08 18:16:53.844285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.844251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"7bab1abd0e6b3d3b0e1c360976ee465561eaaebf56371c3ddff58214eca48da4"} Jul 08 18:16:53.844389 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.844328 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"a32e7e91ed5b4a2aa35c1a7bba43c728b011bfb6415face7bdbff41a49b23965"} Jul 08 18:16:53.844389 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.844376 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"320d9ededef335bc7cde730adb722c2f533b3f3c325c1c72a315199a26ddf8dc"} Jul 08 18:16:53.844483 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.844410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"36605a2f2a11c14393a2a200877bce5f3771aba4ec0ef95ddf7fb35faa114739"} Jul 08 18:16:53.844483 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.844448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"5631cb99fc1a0bd4a1e3f7c617f7db22fa0cf18f5387eae18410dd58c2ae4816"} Jul 08 18:16:53.844561 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.844496 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"77a6c30a20c82251ca033ee069f619d9ba3a8f6e56632bd19b15393f3244fe1a"} Jul 08 18:16:53.845575 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.845553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jfw8c" event={"ID":"0f32314b-f5ce-49e4-bb3e-f2dc956274f6","Type":"ContainerStarted","Data":"be55a347c8aa55376a015b88fa6922a992a804179489537994b94ba325b0d208"} Jul 08 18:16:53.847213 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.847194 2558 generic.go:356] "Generic (PLEG): container finished" podID="10bbd63f-5cbb-4006-a3c7-9255b25420e5" containerID="57a941a4cb7b16b4b0c6b02717460fec928f57aa3de5666ef18948cec5023e5f" exitCode=0 Jul 08 18:16:53.847307 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.847229 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerDied","Data":"57a941a4cb7b16b4b0c6b02717460fec928f57aa3de5666ef18948cec5023e5f"} Jul 08 18:16:53.861405 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:53.861369 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rcmps" podStartSLOduration=4.996935287 podStartE2EDuration="26.861356641s" totalImagesPullingTime="21.864421354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:53.861200752 +0000 UTC m=+26.603269298" watchObservedRunningTime="2026-07-08 18:16:53.861356641 +0000 UTC m=+26.603425192" Jul 08 18:16:54.851864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:54.851838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerStarted","Data":"eaddedc8c4ed07742684f7393653ba6455c51f535c9c5c57a12a006982e69946"} Jul 08 18:16:55.722750 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:55.722715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:55.723314 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:55.722722 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:55.723314 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:55.722836 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:55.723314 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:55.722848 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:55.723314 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:55.722919 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:55.723314 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:55.722991 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:55.856948 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:55.856912 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"a399e72bc20e7f760cb5cec107299e3541e1bf83d93451b6406f7ee3f5f35fb5"} Jul 08 18:16:55.858774 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:55.858747 2558 generic.go:356] "Generic (PLEG): container finished" podID="10bbd63f-5cbb-4006-a3c7-9255b25420e5" containerID="eaddedc8c4ed07742684f7393653ba6455c51f535c9c5c57a12a006982e69946" exitCode=0 Jul 08 18:16:55.858901 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:55.858789 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerDied","Data":"eaddedc8c4ed07742684f7393653ba6455c51f535c9c5c57a12a006982e69946"} Jul 08 18:16:56.863355 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:56.863328 2558 generic.go:356] "Generic (PLEG): container finished" podID="10bbd63f-5cbb-4006-a3c7-9255b25420e5" containerID="641efe4b475386e7c66e45cfc006d33600b09f58fe54f854382ed7acff0f0091" exitCode=0 Jul 08 18:16:56.863721 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:56.863375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerDied","Data":"641efe4b475386e7c66e45cfc006d33600b09f58fe54f854382ed7acff0f0091"} Jul 08 18:16:57.724416 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.724186 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:57.724647 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.724253 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:57.724647 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:57.724417 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:57.724647 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.724294 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:57.724647 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:57.724501 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:57.724647 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:57.724607 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:57.869657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.869615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" event={"ID":"46421e6d-265d-4330-b97f-2e38e3e06161","Type":"ContainerStarted","Data":"f62e7915919da18fe0bcf74bb824cba7fae935b12a13ba0cf8a9cfaadec6d6d0"} Jul 08 18:16:57.870075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.869909 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:57.870075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.869977 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:57.887482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.887459 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:57.887598 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.887558 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:16:57.895719 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:57.895683 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" podStartSLOduration=8.719894224 podStartE2EDuration="30.895669658s" totalImagesPullingTime="22.175775434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:16:57.894926665 +0000 UTC m=+30.636995233" watchObservedRunningTime="2026-07-08 18:16:57.895669658 +0000 UTC m=+30.637738241" Jul 08 18:16:58.872417 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:58.872392 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 18:16:59.612396 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:59.612369 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-czbs4"] Jul 08 18:16:59.612573 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:59.612518 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:16:59.612642 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:59.612621 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:16:59.615564 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:59.615528 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gswlg"] Jul 08 18:16:59.615691 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:59.615621 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:16:59.615742 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:59.615691 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:16:59.616059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:59.616021 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2gp9w"] Jul 08 18:16:59.616169 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:59.616130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:16:59.616286 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:16:59.616226 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:16:59.695398 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:16:59.695317 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:17:00.723379 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:00.723353 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:17:00.723746 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:00.723459 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:17:01.356362 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:01.356332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:17:01.356546 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:01.356376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:01.356546 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.356494 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:17:01.356546 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.356504 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:17:01.356546 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.356521 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:17:01.356546 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.356529 2558 projected.go:196] Error preparing data for projected volume kube-api-access-8x9bf for pod openshift-network-diagnostics/network-check-target-gswlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:17:01.356788 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.356564 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:33.356544645 +0000 UTC m=+66.098613188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:17:01.356788 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.356585 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf podName:9a8fce54-d32f-48bb-a2c7-f0d30dc08956 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:33.356573796 +0000 UTC m=+66.098642330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8x9bf" (UniqueName: "kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf") pod "network-check-target-gswlg" (UID: "9a8fce54-d32f-48bb-a2c7-f0d30dc08956") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:17:01.456867 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:01.456841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:17:01.457006 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.456933 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:17:01.457006 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.456977 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret podName:1157d0fd-f7be-4fea-bfa0-4212d2a77315 nodeName:}" failed. No retries permitted until 2026-07-08 18:17:33.456965577 +0000 UTC m=+66.199034106 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret") pod "global-pull-secret-syncer-czbs4" (UID: "1157d0fd-f7be-4fea-bfa0-4212d2a77315") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:17:01.723234 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:01.723206 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:17:01.723391 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.723366 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:17:01.723443 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:01.723406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:01.723672 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:01.723490 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:17:02.723263 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:02.723076 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:17:02.723441 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:02.723369 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:17:03.722946 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:03.722918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:03.723068 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:03.722918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:17:03.723068 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:03.723039 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gswlg" podUID="9a8fce54-d32f-48bb-a2c7-f0d30dc08956" Jul 08 18:17:03.723173 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:03.723129 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-czbs4" podUID="1157d0fd-f7be-4fea-bfa0-4212d2a77315" Jul 08 18:17:03.886189 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:03.886162 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerStarted","Data":"be8c46ca54913341abf968135987b2de27e00e1988c68e6daa8df26b814f3fc7"} Jul 08 18:17:04.722930 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:04.722904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:17:04.723092 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:04.723010 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2gp9w" podUID="5298fad9-38ff-472e-bace-ca742339abc9" Jul 08 18:17:04.890417 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:04.890386 2558 generic.go:356] "Generic (PLEG): container finished" podID="10bbd63f-5cbb-4006-a3c7-9255b25420e5" containerID="be8c46ca54913341abf968135987b2de27e00e1988c68e6daa8df26b814f3fc7" exitCode=0 Jul 08 18:17:04.890763 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:04.890446 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerDied","Data":"be8c46ca54913341abf968135987b2de27e00e1988c68e6daa8df26b814f3fc7"} Jul 08 18:17:05.605707 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.605672 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-158.ec2.internal" event="NodeReady" Jul 08 18:17:05.605891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.605790 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 18:17:05.647329 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.647297 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wds7g"] Jul 08 18:17:05.661911 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.661881 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hns8x"] Jul 08 18:17:05.662057 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.661999 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.664655 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.664612 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7khc\"" Jul 08 18:17:05.664761 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.664653 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 18:17:05.664761 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.664673 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 18:17:05.675982 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.675962 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wds7g"] Jul 08 18:17:05.676076 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.675993 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hns8x"] Jul 08 18:17:05.676076 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.676062 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:05.678763 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.678582 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 18:17:05.678763 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.678600 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-75wcg\"" Jul 08 18:17:05.678763 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.678628 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 18:17:05.678763 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.678582 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 18:17:05.722984 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.722960 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:05.723201 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.722966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:17:05.725689 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.725669 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:17:05.725809 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.725702 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:17:05.725809 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.725724 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4rm5\"" Jul 08 18:17:05.725809 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.725672 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:17:05.788207 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.788178 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gvzw\" (UniqueName: \"kubernetes.io/projected/b80889e9-89bc-4dc2-bb97-bfa43ad97565-kube-api-access-4gvzw\") pod \"ingress-canary-hns8x\" (UID: \"b80889e9-89bc-4dc2-bb97-bfa43ad97565\") " pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:05.788349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.788227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b80889e9-89bc-4dc2-bb97-bfa43ad97565-cert\") pod \"ingress-canary-hns8x\" (UID: \"b80889e9-89bc-4dc2-bb97-bfa43ad97565\") " pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:05.788349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.788291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-tmp-dir\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.788349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.788322 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q49bv\" (UniqueName: \"kubernetes.io/projected/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-kube-api-access-q49bv\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.788349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.788343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-config-volume\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.788503 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.788383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.889598 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.889574 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gvzw\" (UniqueName: \"kubernetes.io/projected/b80889e9-89bc-4dc2-bb97-bfa43ad97565-kube-api-access-4gvzw\") pod \"ingress-canary-hns8x\" (UID: \"b80889e9-89bc-4dc2-bb97-bfa43ad97565\") " pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:05.889725 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.889615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b80889e9-89bc-4dc2-bb97-bfa43ad97565-cert\") pod \"ingress-canary-hns8x\" (UID: \"b80889e9-89bc-4dc2-bb97-bfa43ad97565\") " pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:05.889725 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.889634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-tmp-dir\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.889725 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.889653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q49bv\" (UniqueName: \"kubernetes.io/projected/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-kube-api-access-q49bv\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.889880 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.889761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-config-volume\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.889880 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.889822 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.889978 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:05.889888 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:05.889978 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.889935 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-tmp-dir\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.889978 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:05.889939 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:17:06.38992125 +0000 UTC m=+39.131989781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:17:05.890343 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.890327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-config-volume\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.893879 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.893858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b80889e9-89bc-4dc2-bb97-bfa43ad97565-cert\") pod \"ingress-canary-hns8x\" (UID: \"b80889e9-89bc-4dc2-bb97-bfa43ad97565\") " pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:05.898465 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.898446 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q49bv\" (UniqueName: \"kubernetes.io/projected/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-kube-api-access-q49bv\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:05.898614 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.898597 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gvzw\" (UniqueName: \"kubernetes.io/projected/b80889e9-89bc-4dc2-bb97-bfa43ad97565-kube-api-access-4gvzw\") pod \"ingress-canary-hns8x\" (UID: \"b80889e9-89bc-4dc2-bb97-bfa43ad97565\") " pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:05.908502 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.908480 2558 generic.go:356] "Generic (PLEG): container finished" podID="10bbd63f-5cbb-4006-a3c7-9255b25420e5" containerID="d624e7e62a7c14f14b8f0e1b40d5f0d2a76a4b437e93acdcbd176c80654e5024" exitCode=0 Jul 08 18:17:05.908582 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.908513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerDied","Data":"d624e7e62a7c14f14b8f0e1b40d5f0d2a76a4b437e93acdcbd176c80654e5024"} Jul 08 18:17:05.984178 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:05.984155 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hns8x" Jul 08 18:17:06.151036 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.150804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hns8x"] Jul 08 18:17:06.154154 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:17:06.154128 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80889e9_89bc_4dc2_bb97_bfa43ad97565.slice/crio-bea66932ba969d37ca5c4ae878df2205d4cd38ae8ccb35e10ac59a8480c0bed9 WatchSource:0}: Error finding container bea66932ba969d37ca5c4ae878df2205d4cd38ae8ccb35e10ac59a8480c0bed9: Status 404 returned error can't find the container with id bea66932ba969d37ca5c4ae878df2205d4cd38ae8ccb35e10ac59a8480c0bed9 Jul 08 18:17:06.394660 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.394632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:06.394819 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:06.394757 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:06.394819 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:06.394810 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:17:07.39479682 +0000 UTC m=+40.136865350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:17:06.723087 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.723052 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:17:06.725370 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.725349 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:17:06.725493 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.725430 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn7hw\"" Jul 08 18:17:06.914213 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.914183 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-snkk7" event={"ID":"10bbd63f-5cbb-4006-a3c7-9255b25420e5","Type":"ContainerStarted","Data":"91f4f6495c45fb0cff76af9b6f7bd3d599b6ac3d0c2b135835da76724ba9bea3"} Jul 08 18:17:06.915348 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.915326 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hns8x" event={"ID":"b80889e9-89bc-4dc2-bb97-bfa43ad97565","Type":"ContainerStarted","Data":"bea66932ba969d37ca5c4ae878df2205d4cd38ae8ccb35e10ac59a8480c0bed9"} Jul 08 18:17:06.945572 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:06.943340 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-snkk7" podStartSLOduration=10.225950028 podStartE2EDuration="39.943321187s" totalImagesPullingTime="29.717371159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:06.941600052 +0000 UTC m=+39.683668614" watchObservedRunningTime="2026-07-08 18:17:06.943321187 +0000 UTC m=+39.685389739" Jul 08 18:17:07.401486 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:07.401445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:07.401657 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:07.401609 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:07.401708 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:07.401697 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:17:09.401679607 +0000 UTC m=+42.143748136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:17:09.417505 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:09.417474 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:09.417962 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:09.417671 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:09.417962 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:09.417751 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:17:13.417728918 +0000 UTC m=+46.159797464 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:17:09.923668 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:09.923639 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hns8x" event={"ID":"b80889e9-89bc-4dc2-bb97-bfa43ad97565","Type":"ContainerStarted","Data":"a3c4f5330cae155c05022cd6a1ad8f43fd39cec6bdd8a4e0da49a414d9f2d199"} Jul 08 18:17:09.939039 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:09.938997 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hns8x" podStartSLOduration=1.975347277 podStartE2EDuration="4.938982406s" totalImagesPullingTime="2.963635129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:09.93868627 +0000 UTC m=+42.680754843" watchObservedRunningTime="2026-07-08 18:17:09.938982406 +0000 UTC m=+42.681050948" Jul 08 18:17:13.443786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:13.443583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:13.443786 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:13.443731 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:13.444190 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:13.443863 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:17:21.443843978 +0000 UTC m=+54.185912506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:17:21.499974 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:21.499940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:21.500482 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:21.500081 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:21.500482 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:21.500140 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:17:37.500125638 +0000 UTC m=+70.242194167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:17:30.892235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:30.892208 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7gb6c" Jul 08 18:17:33.380986 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.380947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:33.381445 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.381020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:17:33.383546 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.383524 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:17:33.383623 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.383610 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:17:33.391802 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:33.391786 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 18:17:33.391859 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:33.391854 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs podName:5298fad9-38ff-472e-bace-ca742339abc9 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:37.391838342 +0000 UTC m=+130.133906884 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs") pod "network-metrics-daemon-2gp9w" (UID: "5298fad9-38ff-472e-bace-ca742339abc9") : secret "metrics-daemon-secret" not found Jul 08 18:17:33.393817 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.393801 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:17:33.406572 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.406549 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x9bf\" (UniqueName: \"kubernetes.io/projected/9a8fce54-d32f-48bb-a2c7-f0d30dc08956-kube-api-access-8x9bf\") pod \"network-check-target-gswlg\" (UID: \"9a8fce54-d32f-48bb-a2c7-f0d30dc08956\") " pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:33.481825 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.481787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:17:33.484585 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.484567 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:17:33.494617 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.494594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1157d0fd-f7be-4fea-bfa0-4212d2a77315-original-pull-secret\") pod \"global-pull-secret-syncer-czbs4\" (UID: \"1157d0fd-f7be-4fea-bfa0-4212d2a77315\") " pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:17:33.634875 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.634797 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4rm5\"" Jul 08 18:17:33.636693 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.636676 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-czbs4" Jul 08 18:17:33.642817 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.642801 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:33.816650 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.816589 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-czbs4"] Jul 08 18:17:33.819182 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:17:33.819159 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1157d0fd_f7be_4fea_bfa0_4212d2a77315.slice/crio-cb3f4ff9c70f4e40fbf76eb4be699b37affc989be9a7b7ba753d78887552c8d7 WatchSource:0}: Error finding container cb3f4ff9c70f4e40fbf76eb4be699b37affc989be9a7b7ba753d78887552c8d7: Status 404 returned error can't find the container with id cb3f4ff9c70f4e40fbf76eb4be699b37affc989be9a7b7ba753d78887552c8d7 Jul 08 18:17:33.831795 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.831773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gswlg"] Jul 08 18:17:33.835449 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:17:33.835418 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8fce54_d32f_48bb_a2c7_f0d30dc08956.slice/crio-72b2b8969d7d99f681ec94449fc49529d98700808df3b00cde89fd6fc03685af WatchSource:0}: Error finding container 72b2b8969d7d99f681ec94449fc49529d98700808df3b00cde89fd6fc03685af: Status 404 returned error can't find the container with id 72b2b8969d7d99f681ec94449fc49529d98700808df3b00cde89fd6fc03685af Jul 08 18:17:33.979723 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.979641 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gswlg" event={"ID":"9a8fce54-d32f-48bb-a2c7-f0d30dc08956","Type":"ContainerStarted","Data":"72b2b8969d7d99f681ec94449fc49529d98700808df3b00cde89fd6fc03685af"} Jul 08 18:17:33.980763 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:33.980742 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-czbs4" event={"ID":"1157d0fd-f7be-4fea-bfa0-4212d2a77315","Type":"ContainerStarted","Data":"cb3f4ff9c70f4e40fbf76eb4be699b37affc989be9a7b7ba753d78887552c8d7"} Jul 08 18:17:37.513040 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:37.512998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:17:37.513482 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:37.513142 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:17:37.513482 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:17:37.513217 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:18:09.513197063 +0000 UTC m=+102.255265594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:17:38.999863 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:38.999830 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-czbs4" event={"ID":"1157d0fd-f7be-4fea-bfa0-4212d2a77315","Type":"ContainerStarted","Data":"ba6862b603cf879ac9a1f57bb20556dc680ac1673e843425dbfa2af9512678ee"} Jul 08 18:17:39.001209 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:39.001184 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gswlg" event={"ID":"9a8fce54-d32f-48bb-a2c7-f0d30dc08956","Type":"ContainerStarted","Data":"913d3a297742684608e9b060b3c001cf85571f5946e6c276db842119c51ca70d"} Jul 08 18:17:39.001350 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:39.001244 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:17:39.014715 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:39.014678 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-czbs4" podStartSLOduration=67.057815773 podStartE2EDuration="1m12.014667595s" totalImagesPullingTime="4.956851822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:39.013838328 +0000 UTC m=+71.755906884" watchObservedRunningTime="2026-07-08 18:17:39.014667595 +0000 UTC m=+71.756736145" Jul 08 18:17:39.028120 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:17:39.028052 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gswlg" podStartSLOduration=67.087714813 podStartE2EDuration="1m12.028037449s" totalImagesPullingTime="4.940322636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:39.027461241 +0000 UTC m=+71.769529789" watchObservedRunningTime="2026-07-08 18:17:39.028037449 +0000 UTC m=+71.770106001" Jul 08 18:18:03.574629 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.574467 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-4p7p6"] Jul 08 18:18:03.577642 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.577615 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.580188 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.580158 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 18:18:03.580371 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.580202 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jsl6z\"" Jul 08 18:18:03.580633 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.580613 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 18:18:03.581638 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.581613 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.581638 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.581638 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.583695 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.583669 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72"] Jul 08 18:18:03.586234 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.586212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.587550 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.587528 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 18:18:03.588895 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.588876 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 18:18:03.589403 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.589375 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.589403 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.589402 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 18:18:03.589600 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.589580 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.589693 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.589667 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pxlk4\"" Jul 08 18:18:03.592905 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.592880 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-4p7p6"] Jul 08 18:18:03.597091 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.597064 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72"] Jul 08 18:18:03.676516 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9944ec00-1b64-4f4c-be5f-80cec2932efa-tmp\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.676628 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676523 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9944ec00-1b64-4f4c-be5f-80cec2932efa-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.676628 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9766cb00-bb63-41bb-b441-421900ea1fc7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.676745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676630 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9944ec00-1b64-4f4c-be5f-80cec2932efa-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.676745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9944ec00-1b64-4f4c-be5f-80cec2932efa-serving-cert\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.676745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gm49\" (UniqueName: \"kubernetes.io/projected/9944ec00-1b64-4f4c-be5f-80cec2932efa-kube-api-access-5gm49\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.676745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6nnk\" (UniqueName: \"kubernetes.io/projected/9766cb00-bb63-41bb-b441-421900ea1fc7-kube-api-access-t6nnk\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.676885 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9944ec00-1b64-4f4c-be5f-80cec2932efa-snapshots\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.676885 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.676776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9766cb00-bb63-41bb-b441-421900ea1fc7-config\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.680762 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.680740 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6c64ff6f99-qbpjr"] Jul 08 18:18:03.682684 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.682667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.685508 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.685480 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 18:18:03.685631 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.685610 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pjds2\"" Jul 08 18:18:03.685692 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.685617 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 18:18:03.685692 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.685647 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 18:18:03.685774 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.685709 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.685816 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.685792 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.685990 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.685974 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 18:18:03.698440 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.698417 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c64ff6f99-qbpjr"] Jul 08 18:18:03.774026 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.774003 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d"] Jul 08 18:18:03.778297 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9944ec00-1b64-4f4c-be5f-80cec2932efa-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.778385 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778322 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9766cb00-bb63-41bb-b441-421900ea1fc7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.778385 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778350 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-default-certificate\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.778385 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-stats-auth\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.778590 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778387 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rn8s\" (UniqueName: \"kubernetes.io/projected/11f0ca37-6215-4ef3-a483-c03c45e378a7-kube-api-access-7rn8s\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.778590 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778501 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9944ec00-1b64-4f4c-be5f-80cec2932efa-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.778590 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778538 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9944ec00-1b64-4f4c-be5f-80cec2932efa-serving-cert\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.778590 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.778788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778609 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gm49\" (UniqueName: \"kubernetes.io/projected/9944ec00-1b64-4f4c-be5f-80cec2932efa-kube-api-access-5gm49\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.778788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6nnk\" (UniqueName: \"kubernetes.io/projected/9766cb00-bb63-41bb-b441-421900ea1fc7-kube-api-access-t6nnk\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.778788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9944ec00-1b64-4f4c-be5f-80cec2932efa-snapshots\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.778788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778690 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9766cb00-bb63-41bb-b441-421900ea1fc7-config\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.778788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778707 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:03.778788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.779075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.778829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9944ec00-1b64-4f4c-be5f-80cec2932efa-tmp\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.779075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.779053 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9944ec00-1b64-4f4c-be5f-80cec2932efa-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.779178 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.779167 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9944ec00-1b64-4f4c-be5f-80cec2932efa-tmp\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.779232 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.779201 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9944ec00-1b64-4f4c-be5f-80cec2932efa-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.779310 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.779253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9766cb00-bb63-41bb-b441-421900ea1fc7-config\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.779824 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.779798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9944ec00-1b64-4f4c-be5f-80cec2932efa-snapshots\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.780826 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.780798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9766cb00-bb63-41bb-b441-421900ea1fc7-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.781427 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.781409 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9944ec00-1b64-4f4c-be5f-80cec2932efa-serving-cert\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.781684 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.781666 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 18:18:03.781770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.781692 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 18:18:03.781825 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.781783 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kqlqk\"" Jul 08 18:18:03.781992 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.781978 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:18:03.787670 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.787649 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d"] Jul 08 18:18:03.792045 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.792025 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6nnk\" (UniqueName: \"kubernetes.io/projected/9766cb00-bb63-41bb-b441-421900ea1fc7-kube-api-access-t6nnk\") pod \"service-ca-operator-5d46d9ffd4-t4w72\" (UID: \"9766cb00-bb63-41bb-b441-421900ea1fc7\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.792425 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.792411 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gm49\" (UniqueName: \"kubernetes.io/projected/9944ec00-1b64-4f4c-be5f-80cec2932efa-kube-api-access-5gm49\") pod \"insights-operator-5c847dcfc4-4p7p6\" (UID: \"9944ec00-1b64-4f4c-be5f-80cec2932efa\") " pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.879836 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.879815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.879912 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.879857 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-default-certificate\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.879912 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.879873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-stats-auth\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.879912 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.879891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rn8s\" (UniqueName: \"kubernetes.io/projected/11f0ca37-6215-4ef3-a483-c03c45e378a7-kube-api-access-7rn8s\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.880046 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.879922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsv7j\" (UniqueName: \"kubernetes.io/projected/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-kube-api-access-xsv7j\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:03.880046 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:03.879956 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:18:03.880046 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:03.880023 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:04.380006281 +0000 UTC m=+97.122074810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : secret "router-metrics-certs-default" not found Jul 08 18:18:03.880233 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.880063 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.880233 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.880104 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:03.880233 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:03.880199 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:04.380183273 +0000 UTC m=+97.122251843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : configmap references non-existent config key: service-ca.crt Jul 08 18:18:03.881945 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.881928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-default-certificate\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.882132 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.882114 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-stats-auth\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.888178 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.888153 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rn8s\" (UniqueName: \"kubernetes.io/projected/11f0ca37-6215-4ef3-a483-c03c45e378a7-kube-api-access-7rn8s\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:03.888260 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.888238 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" Jul 08 18:18:03.897493 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.897470 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" Jul 08 18:18:03.980891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.980866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:03.981014 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.980948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsv7j\" (UniqueName: \"kubernetes.io/projected/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-kube-api-access-xsv7j\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:03.981072 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:03.981033 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:18:03.981116 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:03.981104 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls podName:1bb7cacd-52cf-4bcc-a68f-f8beee6517a1 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:04.481082956 +0000 UTC m=+97.223151488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlj5d" (UID: "1bb7cacd-52cf-4bcc-a68f-f8beee6517a1") : secret "samples-operator-tls" not found Jul 08 18:18:03.989972 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:03.989939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsv7j\" (UniqueName: \"kubernetes.io/projected/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-kube-api-access-xsv7j\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:04.018212 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:04.018180 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-4p7p6"] Jul 08 18:18:04.020935 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:04.020914 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9944ec00_1b64_4f4c_be5f_80cec2932efa.slice/crio-fd5019942280de0e90c1ef3a769948b815f97bc2df8b673fa6b6bb75228be412 WatchSource:0}: Error finding container fd5019942280de0e90c1ef3a769948b815f97bc2df8b673fa6b6bb75228be412: Status 404 returned error can't find the container with id fd5019942280de0e90c1ef3a769948b815f97bc2df8b673fa6b6bb75228be412 Jul 08 18:18:04.030702 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:04.030682 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72"] Jul 08 18:18:04.033366 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:04.033345 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9766cb00_bb63_41bb_b441_421900ea1fc7.slice/crio-4b3f002e1e2bc9a04824a847da5f59b91532c3dd717fc5f2bc745360e2bf742c WatchSource:0}: Error finding container 4b3f002e1e2bc9a04824a847da5f59b91532c3dd717fc5f2bc745360e2bf742c: Status 404 returned error can't find the container with id 4b3f002e1e2bc9a04824a847da5f59b91532c3dd717fc5f2bc745360e2bf742c Jul 08 18:18:04.061478 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:04.061449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" event={"ID":"9944ec00-1b64-4f4c-be5f-80cec2932efa","Type":"ContainerStarted","Data":"fd5019942280de0e90c1ef3a769948b815f97bc2df8b673fa6b6bb75228be412"} Jul 08 18:18:04.062470 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:04.062447 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" event={"ID":"9766cb00-bb63-41bb-b441-421900ea1fc7","Type":"ContainerStarted","Data":"4b3f002e1e2bc9a04824a847da5f59b91532c3dd717fc5f2bc745360e2bf742c"} Jul 08 18:18:04.384263 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:04.384219 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:04.384517 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:04.384322 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:04.384517 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:04.384403 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:05.384383608 +0000 UTC m=+98.126452143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : configmap references non-existent config key: service-ca.crt Jul 08 18:18:04.384517 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:04.384472 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:18:04.384624 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:04.384527 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:05.384513122 +0000 UTC m=+98.126581651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : secret "router-metrics-certs-default" not found Jul 08 18:18:04.484757 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:04.484716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:04.484931 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:04.484878 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:18:04.484985 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:04.484946 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls podName:1bb7cacd-52cf-4bcc-a68f-f8beee6517a1 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:05.484928384 +0000 UTC m=+98.226996937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlj5d" (UID: "1bb7cacd-52cf-4bcc-a68f-f8beee6517a1") : secret "samples-operator-tls" not found Jul 08 18:18:05.391486 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:05.391456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:05.391838 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:05.391503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:05.391838 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:05.391599 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:18:05.391838 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:05.391612 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.391595443 +0000 UTC m=+100.133663971 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : configmap references non-existent config key: service-ca.crt Jul 08 18:18:05.391838 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:05.391638 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.391627237 +0000 UTC m=+100.133695766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : secret "router-metrics-certs-default" not found Jul 08 18:18:05.492687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:05.492652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:05.492857 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:05.492798 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:18:05.492926 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:05.492869 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls podName:1bb7cacd-52cf-4bcc-a68f-f8beee6517a1 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:07.492850747 +0000 UTC m=+100.234919303 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlj5d" (UID: "1bb7cacd-52cf-4bcc-a68f-f8beee6517a1") : secret "samples-operator-tls" not found Jul 08 18:18:06.069393 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:06.069359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" event={"ID":"9944ec00-1b64-4f4c-be5f-80cec2932efa","Type":"ContainerStarted","Data":"f24cbb31993a466d5be66a247ad224b6c1f83a6e22bf3d577261a19e063a879e"} Jul 08 18:18:06.086871 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:06.086833 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" podStartSLOduration=1.153676246 podStartE2EDuration="3.086818534s" totalImagesPullingTime="1.933142288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:06.086229177 +0000 UTC m=+98.828297750" watchObservedRunningTime="2026-07-08 18:18:06.086818534 +0000 UTC m=+98.828887085" Jul 08 18:18:07.073129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.073097 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" event={"ID":"9766cb00-bb63-41bb-b441-421900ea1fc7","Type":"ContainerStarted","Data":"c510d48259a25ad3ee93da16afa69b1b5972b6d2e8f6ce95a92e2734cff698e8"} Jul 08 18:18:07.091117 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.091070 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" podStartSLOduration=1.167375265 podStartE2EDuration="4.091051419s" totalImagesPullingTime="2.923676154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:07.090209308 +0000 UTC m=+99.832277860" watchObservedRunningTime="2026-07-08 18:18:07.091051419 +0000 UTC m=+99.833119975" Jul 08 18:18:07.316830 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.316749 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wl8hk"] Jul 08 18:18:07.320102 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.320078 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.322393 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.322374 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 18:18:07.322673 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.322659 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvjnk\"" Jul 08 18:18:07.322899 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.322885 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 18:18:07.336062 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.336037 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wl8hk"] Jul 08 18:18:07.408825 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.408792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frxx7\" (UniqueName: \"kubernetes.io/projected/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-api-access-frxx7\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.408825 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.408832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:07.408961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.408892 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-crio-socket\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.408961 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.408930 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.40891799 +0000 UTC m=+104.150986520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : configmap references non-existent config key: service-ca.crt Jul 08 18:18:07.408961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.408946 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.409062 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.408966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-data-volume\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.409062 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.408984 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.409062 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.409044 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:07.409146 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.409129 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:18:07.409178 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.409168 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.409156246 +0000 UTC m=+104.151224775 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : secret "router-metrics-certs-default" not found Jul 08 18:18:07.509731 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.509698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-crio-socket\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.509731 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.509737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.509897 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.509757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-data-volume\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.509897 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.509782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.509897 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.509812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-crio-socket\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.509897 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.509830 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:07.509897 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.509867 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:07.509897 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.509878 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:08.009860783 +0000 UTC m=+100.751929312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : configmap "kube-rbac-proxy" not found Jul 08 18:18:07.510372 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.509917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frxx7\" (UniqueName: \"kubernetes.io/projected/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-api-access-frxx7\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.510372 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.509933 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:08.009915539 +0000 UTC m=+100.751984083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:07.510372 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.509992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:07.510372 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.510070 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-data-volume\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:07.510372 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.510095 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:18:07.510372 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:07.510143 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls podName:1bb7cacd-52cf-4bcc-a68f-f8beee6517a1 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.510129598 +0000 UTC m=+104.252198127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlj5d" (UID: "1bb7cacd-52cf-4bcc-a68f-f8beee6517a1") : secret "samples-operator-tls" not found Jul 08 18:18:07.520027 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:07.520010 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frxx7\" (UniqueName: \"kubernetes.io/projected/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-api-access-frxx7\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:08.014504 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:08.014473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:08.014504 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:08.014506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:08.014689 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:08.014588 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:08.014689 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:08.014605 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:08.014689 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:08.014644 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:09.014630277 +0000 UTC m=+101.756698820 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : configmap "kube-rbac-proxy" not found Jul 08 18:18:08.014689 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:08.014658 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:09.014651054 +0000 UTC m=+101.756719583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:08.888622 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:08.888588 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h"] Jul 08 18:18:08.890810 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:08.890789 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" Jul 08 18:18:08.893637 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:08.893617 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pnsnq\"" Jul 08 18:18:08.900196 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:08.900172 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h"] Jul 08 18:18:08.922428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:08.922402 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5sxf\" (UniqueName: \"kubernetes.io/projected/64232f7f-c59f-44f3-b1bf-fc3e25a081bd-kube-api-access-j5sxf\") pod \"network-check-source-989f8b8dc-spd4h\" (UID: \"64232f7f-c59f-44f3-b1bf-fc3e25a081bd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" Jul 08 18:18:09.022809 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.022779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5sxf\" (UniqueName: \"kubernetes.io/projected/64232f7f-c59f-44f3-b1bf-fc3e25a081bd-kube-api-access-j5sxf\") pod \"network-check-source-989f8b8dc-spd4h\" (UID: \"64232f7f-c59f-44f3-b1bf-fc3e25a081bd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" Jul 08 18:18:09.022903 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.022817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:09.022903 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.022841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:09.022997 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:09.022911 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:09.022997 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:09.022947 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:09.022997 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:09.022958 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.022943574 +0000 UTC m=+103.765012102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : configmap "kube-rbac-proxy" not found Jul 08 18:18:09.023139 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:09.023015 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:11.022999824 +0000 UTC m=+103.765068355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:09.032319 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.032296 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5sxf\" (UniqueName: \"kubernetes.io/projected/64232f7f-c59f-44f3-b1bf-fc3e25a081bd-kube-api-access-j5sxf\") pod \"network-check-source-989f8b8dc-spd4h\" (UID: \"64232f7f-c59f-44f3-b1bf-fc3e25a081bd\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" Jul 08 18:18:09.082678 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.082654 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mpwj_987f7a45-3051-4fc6-a2d8-a611d88d2f90/dns-node-resolver/0.log" Jul 08 18:18:09.201145 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.201092 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" Jul 08 18:18:09.322591 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.322507 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h"] Jul 08 18:18:09.325019 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:09.324992 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64232f7f_c59f_44f3_b1bf_fc3e25a081bd.slice/crio-accfa31209c2660d2da9d4aef93c90c83816356308bd39607b2fbd7b5ea09684 WatchSource:0}: Error finding container accfa31209c2660d2da9d4aef93c90c83816356308bd39607b2fbd7b5ea09684: Status 404 returned error can't find the container with id accfa31209c2660d2da9d4aef93c90c83816356308bd39607b2fbd7b5ea09684 Jul 08 18:18:09.527883 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:09.527796 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:18:09.528028 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:09.527935 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:18:09.528028 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:09.527997 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls podName:8a1b82f5-714f-41d9-84f0-028fd0eacd6d nodeName:}" failed. No retries permitted until 2026-07-08 18:19:13.527979121 +0000 UTC m=+166.270047655 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls") pod "dns-default-wds7g" (UID: "8a1b82f5-714f-41d9-84f0-028fd0eacd6d") : secret "dns-default-metrics-tls" not found Jul 08 18:18:10.006708 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:10.006684 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gswlg" Jul 08 18:18:10.082334 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:10.082251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" event={"ID":"64232f7f-c59f-44f3-b1bf-fc3e25a081bd","Type":"ContainerStarted","Data":"e98b2160e1ed69d824a6b69b51a728c637df2711335c0f9f09904abdc3166b52"} Jul 08 18:18:10.082502 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:10.082376 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" event={"ID":"64232f7f-c59f-44f3-b1bf-fc3e25a081bd","Type":"ContainerStarted","Data":"accfa31209c2660d2da9d4aef93c90c83816356308bd39607b2fbd7b5ea09684"} Jul 08 18:18:10.097191 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:10.097147 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-spd4h" podStartSLOduration=2.097131199 podStartE2EDuration="2.097131199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:10.096018525 +0000 UTC m=+102.838087080" watchObservedRunningTime="2026-07-08 18:18:10.097131199 +0000 UTC m=+102.839199755" Jul 08 18:18:10.286002 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:10.285951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ppq4c_a299dc5d-5fb2-4c2b-bd27-5c730b36f679/node-ca/0.log" Jul 08 18:18:10.882879 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:10.882858 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hns8x_b80889e9-89bc-4dc2-bb97-bfa43ad97565/serve-healthcheck-canary/0.log" Jul 08 18:18:11.038951 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:11.038927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:11.039246 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:11.038958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:11.039246 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.039032 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:11.039246 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.039068 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:11.039246 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.039080 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:15.039067704 +0000 UTC m=+107.781136235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : configmap "kube-rbac-proxy" not found Jul 08 18:18:11.039246 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.039125 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:15.039109218 +0000 UTC m=+107.781177750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:11.442586 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:11.442556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:11.442717 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:11.442618 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:11.442717 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.442679 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:18:11.442804 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.442735 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:19.442720398 +0000 UTC m=+112.184788943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : secret "router-metrics-certs-default" not found Jul 08 18:18:11.442804 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.442780 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:19.442763946 +0000 UTC m=+112.184832479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : configmap references non-existent config key: service-ca.crt Jul 08 18:18:11.542898 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:11.542865 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:11.543041 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.542971 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 18:18:11.543041 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:11.543009 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls podName:1bb7cacd-52cf-4bcc-a68f-f8beee6517a1 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:19.542998846 +0000 UTC m=+112.285067375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-rlj5d" (UID: "1bb7cacd-52cf-4bcc-a68f-f8beee6517a1") : secret "samples-operator-tls" not found Jul 08 18:18:15.070299 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:15.067060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:15.070299 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:15.067202 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:18:15.070299 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:15.067369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:15.070299 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:15.067552 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:15.070299 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:15.067670 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:23.067643036 +0000 UTC m=+115.809711614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:15.070299 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:15.067700 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:23.067688513 +0000 UTC m=+115.809757042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : configmap "kube-rbac-proxy" not found Jul 08 18:18:19.502610 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:19.502577 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:19.503054 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:19.502626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:19.503054 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:19.502751 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 18:18:19.503054 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:19.502788 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:35.502772489 +0000 UTC m=+128.244841021 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : configmap references non-existent config key: service-ca.crt Jul 08 18:18:19.503054 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:19.502833 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs podName:11f0ca37-6215-4ef3-a483-c03c45e378a7 nodeName:}" failed. No retries permitted until 2026-07-08 18:18:35.502814471 +0000 UTC m=+128.244883014 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs") pod "router-default-6c64ff6f99-qbpjr" (UID: "11f0ca37-6215-4ef3-a483-c03c45e378a7") : secret "router-metrics-certs-default" not found Jul 08 18:18:19.603065 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:19.603036 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:19.605496 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:19.605479 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1bb7cacd-52cf-4bcc-a68f-f8beee6517a1-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-rlj5d\" (UID: \"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:19.699953 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:19.699932 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" Jul 08 18:18:19.832166 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:19.832141 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d"] Jul 08 18:18:20.121446 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:20.121357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" event={"ID":"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1","Type":"ContainerStarted","Data":"1f2e6127e6c5d347feeb081e321e8dcd2a51c1f1952a1173f10e83814d31ef90"} Jul 08 18:18:22.128501 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:22.128476 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" event={"ID":"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1","Type":"ContainerStarted","Data":"2dd6e5a1b1e32aa3a18746ce6da2a462e819a7af046f15261df4c748ce648e83"} Jul 08 18:18:23.129012 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:23.128974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:23.129454 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:23.129029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:23.129454 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:23.129110 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:18:23.129454 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:23.129187 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls podName:cfb15da7-0fa4-4940-8a2b-e7e070caa55a nodeName:}" failed. No retries permitted until 2026-07-08 18:18:39.129166719 +0000 UTC m=+131.871235265 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wl8hk" (UID: "cfb15da7-0fa4-4940-8a2b-e7e070caa55a") : secret "insights-runtime-extractor-tls" not found Jul 08 18:18:23.129616 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:23.129595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:23.133377 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:23.133344 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" event={"ID":"1bb7cacd-52cf-4bcc-a68f-f8beee6517a1","Type":"ContainerStarted","Data":"efd6ce4ab6d0fab02b6b108fda63c6afe630c7554d7b228d7c74deaef67e6061"} Jul 08 18:18:23.150710 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:23.150670 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-rlj5d" podStartSLOduration=17.991300581 podStartE2EDuration="20.150657644s" totalImagesPullingTime="2.159357063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:23.150373286 +0000 UTC m=+115.892441861" watchObservedRunningTime="2026-07-08 18:18:23.150657644 +0000 UTC m=+115.892726297" Jul 08 18:18:29.005037 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.005006 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s"] Jul 08 18:18:29.007226 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.007209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.010659 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.010630 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 18:18:29.010659 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.010645 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jlnkj\"" Jul 08 18:18:29.010659 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.010650 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 18:18:29.017726 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.017703 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s"] Jul 08 18:18:29.069343 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.069303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/219f2a3f-37f4-4748-8444-f5ecb00bfbe6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6rr5s\" (UID: \"219f2a3f-37f4-4748-8444-f5ecb00bfbe6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.069533 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.069487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/219f2a3f-37f4-4748-8444-f5ecb00bfbe6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6rr5s\" (UID: \"219f2a3f-37f4-4748-8444-f5ecb00bfbe6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.148092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.148062 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9ccbf56b6-f9sbh"] Jul 08 18:18:29.150103 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.150088 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.152519 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.152490 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 18:18:29.152648 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.152489 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xmj8w\"" Jul 08 18:18:29.152648 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.152489 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 18:18:29.152761 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.152713 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 18:18:29.161447 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.160510 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 18:18:29.163818 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.163796 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9ccbf56b6-f9sbh"] Jul 08 18:18:29.170555 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.170506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/219f2a3f-37f4-4748-8444-f5ecb00bfbe6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6rr5s\" (UID: \"219f2a3f-37f4-4748-8444-f5ecb00bfbe6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.170555 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.170550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/219f2a3f-37f4-4748-8444-f5ecb00bfbe6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6rr5s\" (UID: \"219f2a3f-37f4-4748-8444-f5ecb00bfbe6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.171166 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.171142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/219f2a3f-37f4-4748-8444-f5ecb00bfbe6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-6rr5s\" (UID: \"219f2a3f-37f4-4748-8444-f5ecb00bfbe6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.172995 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.172972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/219f2a3f-37f4-4748-8444-f5ecb00bfbe6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-6rr5s\" (UID: \"219f2a3f-37f4-4748-8444-f5ecb00bfbe6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.271530 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95315e80-2cf8-4d83-abc3-e71bf193c722-image-registry-private-configuration\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.271530 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-registry-tls\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.271530 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271509 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9x9h\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-kube-api-access-v9x9h\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.271748 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95315e80-2cf8-4d83-abc3-e71bf193c722-trusted-ca\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.271748 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271626 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95315e80-2cf8-4d83-abc3-e71bf193c722-registry-certificates\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.271748 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95315e80-2cf8-4d83-abc3-e71bf193c722-installation-pull-secrets\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.271748 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-bound-sa-token\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.271881 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.271764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95315e80-2cf8-4d83-abc3-e71bf193c722-ca-trust-extracted\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.315463 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.315431 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" Jul 08 18:18:29.372638 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-bound-sa-token\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.373082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95315e80-2cf8-4d83-abc3-e71bf193c722-ca-trust-extracted\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.373082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95315e80-2cf8-4d83-abc3-e71bf193c722-image-registry-private-configuration\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.373082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372760 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-registry-tls\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.373082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9x9h\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-kube-api-access-v9x9h\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.373082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95315e80-2cf8-4d83-abc3-e71bf193c722-trusted-ca\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.373082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95315e80-2cf8-4d83-abc3-e71bf193c722-registry-certificates\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.373082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.372910 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95315e80-2cf8-4d83-abc3-e71bf193c722-installation-pull-secrets\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.374187 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.373174 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/95315e80-2cf8-4d83-abc3-e71bf193c722-ca-trust-extracted\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.374187 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.374156 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/95315e80-2cf8-4d83-abc3-e71bf193c722-registry-certificates\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.375514 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.375485 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/95315e80-2cf8-4d83-abc3-e71bf193c722-trusted-ca\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.376850 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.376684 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/95315e80-2cf8-4d83-abc3-e71bf193c722-installation-pull-secrets\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.376850 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.376798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-registry-tls\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.377835 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.377810 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/95315e80-2cf8-4d83-abc3-e71bf193c722-image-registry-private-configuration\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.381001 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.380975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-bound-sa-token\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.381197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.381181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9x9h\" (UniqueName: \"kubernetes.io/projected/95315e80-2cf8-4d83-abc3-e71bf193c722-kube-api-access-v9x9h\") pod \"image-registry-9ccbf56b6-f9sbh\" (UID: \"95315e80-2cf8-4d83-abc3-e71bf193c722\") " pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.441832 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.441804 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s"] Jul 08 18:18:29.444449 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:29.444424 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219f2a3f_37f4_4748_8444_f5ecb00bfbe6.slice/crio-5c7ac497b8d7d438ec876245bfb73e4cec80e4dce975d11b8c30169325c202ee WatchSource:0}: Error finding container 5c7ac497b8d7d438ec876245bfb73e4cec80e4dce975d11b8c30169325c202ee: Status 404 returned error can't find the container with id 5c7ac497b8d7d438ec876245bfb73e4cec80e4dce975d11b8c30169325c202ee Jul 08 18:18:29.463684 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.463666 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:29.581793 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:29.581762 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9ccbf56b6-f9sbh"] Jul 08 18:18:29.584534 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:29.584508 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95315e80_2cf8_4d83_abc3_e71bf193c722.slice/crio-a71464dc07db7da8b27429c268bcd07201511c1054c69348044292850e4677b8 WatchSource:0}: Error finding container a71464dc07db7da8b27429c268bcd07201511c1054c69348044292850e4677b8: Status 404 returned error can't find the container with id a71464dc07db7da8b27429c268bcd07201511c1054c69348044292850e4677b8 Jul 08 18:18:30.158282 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:30.158240 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" event={"ID":"95315e80-2cf8-4d83-abc3-e71bf193c722","Type":"ContainerStarted","Data":"e9e9bd3f4f854a1b966b6f46e5d4a4a9d37e70a35e347f392993e485e5a0e544"} Jul 08 18:18:30.158722 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:30.158324 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" event={"ID":"95315e80-2cf8-4d83-abc3-e71bf193c722","Type":"ContainerStarted","Data":"a71464dc07db7da8b27429c268bcd07201511c1054c69348044292850e4677b8"} Jul 08 18:18:30.158722 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:30.158346 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:30.159438 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:30.159415 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" event={"ID":"219f2a3f-37f4-4748-8444-f5ecb00bfbe6","Type":"ContainerStarted","Data":"5c7ac497b8d7d438ec876245bfb73e4cec80e4dce975d11b8c30169325c202ee"} Jul 08 18:18:30.177017 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:30.176974 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" podStartSLOduration=1.1769603100000001 podStartE2EDuration="1.17696031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:30.176068083 +0000 UTC m=+122.918136634" watchObservedRunningTime="2026-07-08 18:18:30.17696031 +0000 UTC m=+122.919028862" Jul 08 18:18:31.164813 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:31.164777 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" event={"ID":"219f2a3f-37f4-4748-8444-f5ecb00bfbe6","Type":"ContainerStarted","Data":"567a2d0b267c2ea080cd9ecb0cb9c868c6c102eaab5561aa1f8c45f7fc8f92bf"} Jul 08 18:18:31.180825 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:31.179962 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-6rr5s" podStartSLOduration=1.971739376 podStartE2EDuration="3.179941655s" totalImagesPullingTime="1.208202279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:31.179549213 +0000 UTC m=+123.921617763" watchObservedRunningTime="2026-07-08 18:18:31.179941655 +0000 UTC m=+123.922010207" Jul 08 18:18:35.521810 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:35.521763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:35.522350 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:35.521837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:35.522610 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:35.522587 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11f0ca37-6215-4ef3-a483-c03c45e378a7-service-ca-bundle\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:35.524064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:35.524045 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/11f0ca37-6215-4ef3-a483-c03c45e378a7-metrics-certs\") pod \"router-default-6c64ff6f99-qbpjr\" (UID: \"11f0ca37-6215-4ef3-a483-c03c45e378a7\") " pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:35.794375 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:35.794264 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pjds2\"" Jul 08 18:18:35.802311 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:35.802265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:35.935962 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:35.935934 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6c64ff6f99-qbpjr"] Jul 08 18:18:35.938834 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:35.938807 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f0ca37_6215_4ef3_a483_c03c45e378a7.slice/crio-7cddde0e6e026b78b386af6344c58fb76343effca7f635f6edccbfb0144ab3b1 WatchSource:0}: Error finding container 7cddde0e6e026b78b386af6344c58fb76343effca7f635f6edccbfb0144ab3b1: Status 404 returned error can't find the container with id 7cddde0e6e026b78b386af6344c58fb76343effca7f635f6edccbfb0144ab3b1 Jul 08 18:18:36.182604 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:36.182563 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" event={"ID":"11f0ca37-6215-4ef3-a483-c03c45e378a7","Type":"ContainerStarted","Data":"b0bb2843bea9adb016ff355598c4c4b658e8e119f303d33797a03d916fdedf96"} Jul 08 18:18:36.182951 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:36.182630 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" event={"ID":"11f0ca37-6215-4ef3-a483-c03c45e378a7","Type":"ContainerStarted","Data":"7cddde0e6e026b78b386af6344c58fb76343effca7f635f6edccbfb0144ab3b1"} Jul 08 18:18:36.203414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:36.203363 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" podStartSLOduration=33.2033487 podStartE2EDuration="33.2033487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:36.202849557 +0000 UTC m=+128.944918146" watchObservedRunningTime="2026-07-08 18:18:36.2033487 +0000 UTC m=+128.945417250" Jul 08 18:18:36.803435 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:36.803406 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:36.805737 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:36.805718 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:37.185308 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:37.185261 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:37.186513 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:37.186496 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6c64ff6f99-qbpjr" Jul 08 18:18:37.437915 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:37.437836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:18:37.440022 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:37.439995 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5298fad9-38ff-472e-bace-ca742339abc9-metrics-certs\") pod \"network-metrics-daemon-2gp9w\" (UID: \"5298fad9-38ff-472e-bace-ca742339abc9\") " pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:18:37.634172 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:37.634140 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hn7hw\"" Jul 08 18:18:37.642394 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:37.642370 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2gp9w" Jul 08 18:18:37.766459 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:37.766425 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2gp9w"] Jul 08 18:18:37.769318 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:37.769292 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5298fad9_38ff_472e_bace_ca742339abc9.slice/crio-d4b678bc6c10e83706ddc1572546064e2258c9e93b06e81b208ef555734109aa WatchSource:0}: Error finding container d4b678bc6c10e83706ddc1572546064e2258c9e93b06e81b208ef555734109aa: Status 404 returned error can't find the container with id d4b678bc6c10e83706ddc1572546064e2258c9e93b06e81b208ef555734109aa Jul 08 18:18:38.188997 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.188958 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gp9w" event={"ID":"5298fad9-38ff-472e-bace-ca742339abc9","Type":"ContainerStarted","Data":"d4b678bc6c10e83706ddc1572546064e2258c9e93b06e81b208ef555734109aa"} Jul 08 18:18:38.601672 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.601598 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22"] Jul 08 18:18:38.604155 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.604131 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" Jul 08 18:18:38.606861 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.606838 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 18:18:38.606963 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.606868 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lhfll\"" Jul 08 18:18:38.612522 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.611924 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22"] Jul 08 18:18:38.747513 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.747475 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/18701abd-89e7-4a75-8e77-832c95319424-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6wc22\" (UID: \"18701abd-89e7-4a75-8e77-832c95319424\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" Jul 08 18:18:38.848206 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.848176 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/18701abd-89e7-4a75-8e77-832c95319424-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6wc22\" (UID: \"18701abd-89e7-4a75-8e77-832c95319424\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" Jul 08 18:18:38.850943 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.850917 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/18701abd-89e7-4a75-8e77-832c95319424-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6wc22\" (UID: \"18701abd-89e7-4a75-8e77-832c95319424\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" Jul 08 18:18:38.914786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:38.914759 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" Jul 08 18:18:39.037352 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.037308 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22"] Jul 08 18:18:39.039921 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:39.039890 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18701abd_89e7_4a75_8e77_832c95319424.slice/crio-75ebb58abd0ae82a36179f2e9ae3ec88f7f9dfbdface60932e8ffee228fe51c4 WatchSource:0}: Error finding container 75ebb58abd0ae82a36179f2e9ae3ec88f7f9dfbdface60932e8ffee228fe51c4: Status 404 returned error can't find the container with id 75ebb58abd0ae82a36179f2e9ae3ec88f7f9dfbdface60932e8ffee228fe51c4 Jul 08 18:18:39.151773 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.151675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:39.154025 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.153995 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfb15da7-0fa4-4940-8a2b-e7e070caa55a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wl8hk\" (UID: \"cfb15da7-0fa4-4940-8a2b-e7e070caa55a\") " pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:39.193128 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.193082 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" event={"ID":"18701abd-89e7-4a75-8e77-832c95319424","Type":"ContainerStarted","Data":"75ebb58abd0ae82a36179f2e9ae3ec88f7f9dfbdface60932e8ffee228fe51c4"} Jul 08 18:18:39.194779 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.194753 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gp9w" event={"ID":"5298fad9-38ff-472e-bace-ca742339abc9","Type":"ContainerStarted","Data":"4fdab2b4cc29593ebff069c3e7b8b70d10cbc661fd59f9147fd4ec0c0ba24b21"} Jul 08 18:18:39.194885 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.194796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2gp9w" event={"ID":"5298fad9-38ff-472e-bace-ca742339abc9","Type":"ContainerStarted","Data":"b60fd72f4b06c7edf2d3921deaf5ba540df21eac272b8c4c4d87bf1d20bd3afe"} Jul 08 18:18:39.212165 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.212120 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2gp9w" podStartSLOduration=131.234226812 podStartE2EDuration="2m12.21210427s" totalImagesPullingTime="977.877458ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:16:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:39.210655794 +0000 UTC m=+131.952724346" watchObservedRunningTime="2026-07-08 18:18:39.21210427 +0000 UTC m=+131.954172820" Jul 08 18:18:39.433499 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.433405 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jvjnk\"" Jul 08 18:18:39.441584 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.441564 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wl8hk" Jul 08 18:18:39.594798 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:39.594764 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wl8hk"] Jul 08 18:18:39.598012 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:39.597985 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb15da7_0fa4_4940_8a2b_e7e070caa55a.slice/crio-5d33a9fd77f4b3cb3859d791676d6dd7e2c177219b688063a6982459ac95aac6 WatchSource:0}: Error finding container 5d33a9fd77f4b3cb3859d791676d6dd7e2c177219b688063a6982459ac95aac6: Status 404 returned error can't find the container with id 5d33a9fd77f4b3cb3859d791676d6dd7e2c177219b688063a6982459ac95aac6 Jul 08 18:18:40.205374 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:40.205337 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl8hk" event={"ID":"cfb15da7-0fa4-4940-8a2b-e7e070caa55a","Type":"ContainerStarted","Data":"5d33a9fd77f4b3cb3859d791676d6dd7e2c177219b688063a6982459ac95aac6"} Jul 08 18:18:41.210416 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:41.210373 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" event={"ID":"18701abd-89e7-4a75-8e77-832c95319424","Type":"ContainerStarted","Data":"d411ba420a4860dca4c46ad709aef26dc4aef1699a4af88d37739d049c763851"} Jul 08 18:18:41.210961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:41.210682 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" Jul 08 18:18:41.216095 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:41.216070 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" Jul 08 18:18:41.227310 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:41.227245 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6wc22" podStartSLOduration=1.916801565 podStartE2EDuration="3.227227739s" totalImagesPullingTime="1.310426174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:41.227191514 +0000 UTC m=+133.969260087" watchObservedRunningTime="2026-07-08 18:18:41.227227739 +0000 UTC m=+133.969296291" Jul 08 18:18:44.223624 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:44.223590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl8hk" event={"ID":"cfb15da7-0fa4-4940-8a2b-e7e070caa55a","Type":"ContainerStarted","Data":"bbea93e91417e3864bf393b93411b5af3e639d55c8d9662dd6ddf85abd4b5d6b"} Jul 08 18:18:45.229700 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:45.229660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl8hk" event={"ID":"cfb15da7-0fa4-4940-8a2b-e7e070caa55a","Type":"ContainerStarted","Data":"fda0a6295a3b1b53d48a1ce6e866d88260306e7ca77f47e16780986d90958793"} Jul 08 18:18:47.239319 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:47.239254 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wl8hk" event={"ID":"cfb15da7-0fa4-4940-8a2b-e7e070caa55a","Type":"ContainerStarted","Data":"a0e82178bb928789c9a6b4211867aea7d9f3c3f044a3ea47e0805e0dbede86cf"} Jul 08 18:18:47.258252 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:47.256999 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wl8hk" podStartSLOduration=33.17637872 podStartE2EDuration="40.256981357s" totalImagesPullingTime="7.080602637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:47.256774709 +0000 UTC m=+139.998843281" watchObservedRunningTime="2026-07-08 18:18:47.256981357 +0000 UTC m=+139.999049908" Jul 08 18:18:48.027753 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.027724 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq"] Jul 08 18:18:48.031025 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.031009 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.033363 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.033332 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 18:18:48.034643 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.034493 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bvsbp\"" Jul 08 18:18:48.034643 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.034596 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 18:18:48.034643 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.034598 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 18:18:48.034643 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.034622 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 18:18:48.034643 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.034609 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 18:18:48.034980 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.034770 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 18:18:48.037923 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.037891 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-slt57"] Jul 08 18:18:48.041238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.041221 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.043043 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.043016 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq"] Jul 08 18:18:48.043800 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.043784 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 18:18:48.044064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.044028 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 18:18:48.044160 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.044037 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gvc99\"" Jul 08 18:18:48.044160 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.044081 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 18:18:48.123671 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.123652 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.123781 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.123690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.123781 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.123747 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0040899-243a-4510-ad6e-8708abf3fe8e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.123781 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.123776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgwnd\" (UniqueName: \"kubernetes.io/projected/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-api-access-rgwnd\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.123933 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.123820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b0040899-243a-4510-ad6e-8708abf3fe8e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.123933 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.123869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.224514 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224488 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-root\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224519 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0040899-243a-4510-ad6e-8708abf3fe8e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.224612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-accelerators-collector-config\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224554 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgwnd\" (UniqueName: \"kubernetes.io/projected/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-api-access-rgwnd\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.224612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-wtmp\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224615 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224644 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b0040899-243a-4510-ad6e-8708abf3fe8e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.224782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-textfile\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.224782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224765 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-tls\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224975 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv2cw\" (UniqueName: \"kubernetes.io/projected/fec9a117-9c88-44f4-b525-5c9dd8e41c14-kube-api-access-rv2cw\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224975 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-sys\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224975 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.224975 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec9a117-9c88-44f4-b525-5c9dd8e41c14-metrics-client-ca\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.224975 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.224940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.225186 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:48.225057 2558 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 18:18:48.225186 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.225065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b0040899-243a-4510-ad6e-8708abf3fe8e-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.225186 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:18:48.225121 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-tls podName:b0040899-243a-4510-ad6e-8708abf3fe8e nodeName:}" failed. No retries permitted until 2026-07-08 18:18:48.725102742 +0000 UTC m=+141.467171271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-m5dsq" (UID: "b0040899-243a-4510-ad6e-8708abf3fe8e") : secret "kube-state-metrics-tls" not found Jul 08 18:18:48.225354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.225335 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0040899-243a-4510-ad6e-8708abf3fe8e-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.225556 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.225533 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.227085 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.227067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.231693 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.231673 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgwnd\" (UniqueName: \"kubernetes.io/projected/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-api-access-rgwnd\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.325299 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325208 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325299 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-textfile\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325402 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-tls\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv2cw\" (UniqueName: \"kubernetes.io/projected/fec9a117-9c88-44f4-b525-5c9dd8e41c14-kube-api-access-rv2cw\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-textfile\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325563 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-sys\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325606 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec9a117-9c88-44f4-b525-5c9dd8e41c14-metrics-client-ca\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325657 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-sys\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-root\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.325746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325704 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-root\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.326119 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-accelerators-collector-config\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.326119 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-wtmp\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.326119 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.325951 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-wtmp\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.326290 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.326127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fec9a117-9c88-44f4-b525-5c9dd8e41c14-metrics-client-ca\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.326528 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.326507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-accelerators-collector-config\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.327812 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.327786 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-tls\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.328288 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.328247 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fec9a117-9c88-44f4-b525-5c9dd8e41c14-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.336692 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.336667 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv2cw\" (UniqueName: \"kubernetes.io/projected/fec9a117-9c88-44f4-b525-5c9dd8e41c14-kube-api-access-rv2cw\") pod \"node-exporter-slt57\" (UID: \"fec9a117-9c88-44f4-b525-5c9dd8e41c14\") " pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.349647 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.349625 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-slt57" Jul 08 18:18:48.362363 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:48.362338 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfec9a117_9c88_44f4_b525_5c9dd8e41c14.slice/crio-082360687bc0c225806de9e3e214b09478461bb6e9b0af1ea1410e77f8b60672 WatchSource:0}: Error finding container 082360687bc0c225806de9e3e214b09478461bb6e9b0af1ea1410e77f8b60672: Status 404 returned error can't find the container with id 082360687bc0c225806de9e3e214b09478461bb6e9b0af1ea1410e77f8b60672 Jul 08 18:18:48.729096 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.729068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.731142 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.731119 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0040899-243a-4510-ad6e-8708abf3fe8e-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-m5dsq\" (UID: \"b0040899-243a-4510-ad6e-8708abf3fe8e\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:48.940201 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:48.940182 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" Jul 08 18:18:49.078332 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.078293 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq"] Jul 08 18:18:49.081856 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:49.081830 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0040899_243a_4510_ad6e_8708abf3fe8e.slice/crio-adbd9a95d2a9c36aa6edeae646bcc2b960fbdbfd02cd8da8e413b1b068188b3c WatchSource:0}: Error finding container adbd9a95d2a9c36aa6edeae646bcc2b960fbdbfd02cd8da8e413b1b068188b3c: Status 404 returned error can't find the container with id adbd9a95d2a9c36aa6edeae646bcc2b960fbdbfd02cd8da8e413b1b068188b3c Jul 08 18:18:49.140914 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.140885 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:18:49.144447 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.144429 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.147054 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147006 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 18:18:49.147188 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147167 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qzdqh\"" Jul 08 18:18:49.147283 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147198 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 18:18:49.147283 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147167 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 18:18:49.147283 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147233 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 18:18:49.147521 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147284 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 18:18:49.147568 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147543 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 18:18:49.147622 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147577 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 18:18:49.147675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.147618 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 18:18:49.153967 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.153947 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 18:18:49.162744 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.162723 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:18:49.253093 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.253033 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" event={"ID":"b0040899-243a-4510-ad6e-8708abf3fe8e","Type":"ContainerStarted","Data":"adbd9a95d2a9c36aa6edeae646bcc2b960fbdbfd02cd8da8e413b1b068188b3c"} Jul 08 18:18:49.254426 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.254341 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slt57" event={"ID":"fec9a117-9c88-44f4-b525-5c9dd8e41c14","Type":"ContainerStarted","Data":"082360687bc0c225806de9e3e214b09478461bb6e9b0af1ea1410e77f8b60672"} Jul 08 18:18:49.333740 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.333689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.333758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-web-config\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.333808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.333845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.333872 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.333955 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.333990 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.334021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvqh6\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-kube-api-access-wvqh6\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.334056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.334088 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334529 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.334167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334529 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.334226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.334529 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.334282 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-out\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.435711 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435678 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.435864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-web-config\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.435864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.435864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.435864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.435864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435842 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435893 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvqh6\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-kube-api-access-wvqh6\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.435963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.436012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.436045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.436091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-out\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.436532 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.436122 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.437768 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.437738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.438580 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.438516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.438739 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.438716 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.439158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.439131 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.439491 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.439469 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-web-config\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.439706 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.439668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-out\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.440393 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.440352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-volume\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.440537 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.440518 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.440906 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.440829 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.441169 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.441143 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.442548 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.442524 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.448099 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.448076 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvqh6\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-kube-api-access-wvqh6\") pod \"alertmanager-main-0\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.456010 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.455947 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:18:49.624502 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:49.624446 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:18:49.626194 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:49.626164 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac9500f_438c_46c0_a38d_ea34f6ba1c7f.slice/crio-7366427e9f9a3e31f46427ed4934781615b3862c35a41f91c8689d40e7391ed2 WatchSource:0}: Error finding container 7366427e9f9a3e31f46427ed4934781615b3862c35a41f91c8689d40e7391ed2: Status 404 returned error can't find the container with id 7366427e9f9a3e31f46427ed4934781615b3862c35a41f91c8689d40e7391ed2 Jul 08 18:18:50.259965 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:50.259928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerStarted","Data":"7366427e9f9a3e31f46427ed4934781615b3862c35a41f91c8689d40e7391ed2"} Jul 08 18:18:50.261918 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:50.261889 2558 generic.go:356] "Generic (PLEG): container finished" podID="fec9a117-9c88-44f4-b525-5c9dd8e41c14" containerID="16e68f17bf4da146c3a33ecdec23ce6b82445bdcf298624ed29da7ae85879da3" exitCode=0 Jul 08 18:18:50.262066 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:50.261935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slt57" event={"ID":"fec9a117-9c88-44f4-b525-5c9dd8e41c14","Type":"ContainerDied","Data":"16e68f17bf4da146c3a33ecdec23ce6b82445bdcf298624ed29da7ae85879da3"} Jul 08 18:18:51.169578 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.169554 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9ccbf56b6-f9sbh" Jul 08 18:18:51.267653 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.267625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" event={"ID":"b0040899-243a-4510-ad6e-8708abf3fe8e","Type":"ContainerStarted","Data":"7c1404a3adbccc3e1c71df8a7406c581c09c899735a226fb610d1ffc100618da"} Jul 08 18:18:51.267798 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.267683 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" event={"ID":"b0040899-243a-4510-ad6e-8708abf3fe8e","Type":"ContainerStarted","Data":"5e00f7e568b7a4fa82e83bcd52e9f7fae42168b2dc8ce8c3a2f7f430666f7993"} Jul 08 18:18:51.267798 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.267710 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" event={"ID":"b0040899-243a-4510-ad6e-8708abf3fe8e","Type":"ContainerStarted","Data":"2b5dc810292a199bf270bb3491664a5268694ed8964e6d5354f4fe552ac3723f"} Jul 08 18:18:51.269333 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.269307 2558 generic.go:356] "Generic (PLEG): container finished" podID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerID="e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23" exitCode=0 Jul 08 18:18:51.269441 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.269396 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23"} Jul 08 18:18:51.272161 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.272138 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slt57" event={"ID":"fec9a117-9c88-44f4-b525-5c9dd8e41c14","Type":"ContainerStarted","Data":"3dadebf8444861a7a9bfd842b07d0c08831cfa9845cd9b419c8e91a67509fd49"} Jul 08 18:18:51.272244 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.272186 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-slt57" event={"ID":"fec9a117-9c88-44f4-b525-5c9dd8e41c14","Type":"ContainerStarted","Data":"86957510a01691d17fd429033deb4e8009366aa0cb01ab90dbe3995b75f3dcba"} Jul 08 18:18:51.287209 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.287163 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-m5dsq" podStartSLOduration=1.946150853 podStartE2EDuration="3.287148235s" totalImagesPullingTime="1.340997382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:51.286989021 +0000 UTC m=+144.029057574" watchObservedRunningTime="2026-07-08 18:18:51.287148235 +0000 UTC m=+144.029216785" Jul 08 18:18:51.313194 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:51.313155 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-slt57" podStartSLOduration=2.07028582 podStartE2EDuration="3.31314343s" totalImagesPullingTime="1.176904429s" totalInitContainerRuntime="65.953181ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:51.311363165 +0000 UTC m=+144.053431737" watchObservedRunningTime="2026-07-08 18:18:51.31314343 +0000 UTC m=+144.055212023" Jul 08 18:18:52.406822 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.406789 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-74867df568-vlntv"] Jul 08 18:18:52.412028 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.410491 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.413438 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.413397 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 18:18:52.413567 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.413406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-w5blk\"" Jul 08 18:18:52.413567 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.413523 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 18:18:52.414540 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.414510 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 18:18:52.414671 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.414513 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 18:18:52.414740 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.414516 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-45ipk6qhomupk\"" Jul 08 18:18:52.419126 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.419107 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74867df568-vlntv"] Jul 08 18:18:52.560520 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.560486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/706f152f-285e-4b09-8256-6fc9f5902685-metrics-server-audit-profiles\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.560675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.560539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-client-ca-bundle\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.560675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.560663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-secret-metrics-server-client-certs\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.560774 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.560697 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkvc9\" (UniqueName: \"kubernetes.io/projected/706f152f-285e-4b09-8256-6fc9f5902685-kube-api-access-rkvc9\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.560774 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.560725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-secret-metrics-server-tls\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.560774 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.560769 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/706f152f-285e-4b09-8256-6fc9f5902685-audit-log\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.560979 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.560846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706f152f-285e-4b09-8256-6fc9f5902685-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.661922 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.661846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-secret-metrics-server-client-certs\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.661922 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.661895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkvc9\" (UniqueName: \"kubernetes.io/projected/706f152f-285e-4b09-8256-6fc9f5902685-kube-api-access-rkvc9\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.662118 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.661923 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-secret-metrics-server-tls\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.662118 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.661972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/706f152f-285e-4b09-8256-6fc9f5902685-audit-log\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.662118 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.662010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706f152f-285e-4b09-8256-6fc9f5902685-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.662118 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.662037 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/706f152f-285e-4b09-8256-6fc9f5902685-metrics-server-audit-profiles\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.662118 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.662068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-client-ca-bundle\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.662663 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.662613 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/706f152f-285e-4b09-8256-6fc9f5902685-audit-log\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.663534 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.663498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/706f152f-285e-4b09-8256-6fc9f5902685-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.663641 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.663569 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/706f152f-285e-4b09-8256-6fc9f5902685-metrics-server-audit-profiles\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.664787 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.664761 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-secret-metrics-server-client-certs\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.664912 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.664799 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-secret-metrics-server-tls\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.665315 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.665258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/706f152f-285e-4b09-8256-6fc9f5902685-client-ca-bundle\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.671403 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.671386 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkvc9\" (UniqueName: \"kubernetes.io/projected/706f152f-285e-4b09-8256-6fc9f5902685-kube-api-access-rkvc9\") pod \"metrics-server-74867df568-vlntv\" (UID: \"706f152f-285e-4b09-8256-6fc9f5902685\") " pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.724412 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.724387 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:18:52.796296 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.795684 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr"] Jul 08 18:18:52.802296 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.802245 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:52.806953 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.806419 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 18:18:52.806953 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.806709 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-j56n2\"" Jul 08 18:18:52.808116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.808091 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr"] Jul 08 18:18:52.875008 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.874986 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-74867df568-vlntv"] Jul 08 18:18:52.876992 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:52.876968 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706f152f_285e_4b09_8256_6fc9f5902685.slice/crio-17dd8b45d783ac91fb15ed077058251fe6fa72e7a71ea437ef86adea67e2338d WatchSource:0}: Error finding container 17dd8b45d783ac91fb15ed077058251fe6fa72e7a71ea437ef86adea67e2338d: Status 404 returned error can't find the container with id 17dd8b45d783ac91fb15ed077058251fe6fa72e7a71ea437ef86adea67e2338d Jul 08 18:18:52.964212 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.964175 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00af267f-eca4-4323-bb0f-968c9b7a42b7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5x7mr\" (UID: \"00af267f-eca4-4323-bb0f-968c9b7a42b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:52.964337 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:52.964320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6bzl\" (UniqueName: \"kubernetes.io/projected/00af267f-eca4-4323-bb0f-968c9b7a42b7-kube-api-access-w6bzl\") pod \"monitoring-plugin-d5dcff7cf-5x7mr\" (UID: \"00af267f-eca4-4323-bb0f-968c9b7a42b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:53.064785 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.064757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00af267f-eca4-4323-bb0f-968c9b7a42b7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5x7mr\" (UID: \"00af267f-eca4-4323-bb0f-968c9b7a42b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:53.065069 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.064894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6bzl\" (UniqueName: \"kubernetes.io/projected/00af267f-eca4-4323-bb0f-968c9b7a42b7-kube-api-access-w6bzl\") pod \"monitoring-plugin-d5dcff7cf-5x7mr\" (UID: \"00af267f-eca4-4323-bb0f-968c9b7a42b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:53.067891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.067859 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/00af267f-eca4-4323-bb0f-968c9b7a42b7-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5x7mr\" (UID: \"00af267f-eca4-4323-bb0f-968c9b7a42b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:53.072935 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.072907 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6bzl\" (UniqueName: \"kubernetes.io/projected/00af267f-eca4-4323-bb0f-968c9b7a42b7-kube-api-access-w6bzl\") pod \"monitoring-plugin-d5dcff7cf-5x7mr\" (UID: \"00af267f-eca4-4323-bb0f-968c9b7a42b7\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:53.120370 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.120352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:53.244048 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.244025 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr"] Jul 08 18:18:53.246388 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:53.246365 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00af267f_eca4_4323_bb0f_968c9b7a42b7.slice/crio-cb5862de2b89a02fa6a94a8140ef38ef5bd5fa5a1c57a9b08eafbef8bf7cb817 WatchSource:0}: Error finding container cb5862de2b89a02fa6a94a8140ef38ef5bd5fa5a1c57a9b08eafbef8bf7cb817: Status 404 returned error can't find the container with id cb5862de2b89a02fa6a94a8140ef38ef5bd5fa5a1c57a9b08eafbef8bf7cb817 Jul 08 18:18:53.281232 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.281205 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74867df568-vlntv" event={"ID":"706f152f-285e-4b09-8256-6fc9f5902685","Type":"ContainerStarted","Data":"17dd8b45d783ac91fb15ed077058251fe6fa72e7a71ea437ef86adea67e2338d"} Jul 08 18:18:53.283986 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.283963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerStarted","Data":"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a"} Jul 08 18:18:53.284082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.284032 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerStarted","Data":"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2"} Jul 08 18:18:53.284082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.284079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerStarted","Data":"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43"} Jul 08 18:18:53.284192 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.284119 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerStarted","Data":"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa"} Jul 08 18:18:53.284192 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.284162 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerStarted","Data":"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4"} Jul 08 18:18:53.285039 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:53.285019 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" event={"ID":"00af267f-eca4-4323-bb0f-968c9b7a42b7","Type":"ContainerStarted","Data":"cb5862de2b89a02fa6a94a8140ef38ef5bd5fa5a1c57a9b08eafbef8bf7cb817"} Jul 08 18:18:54.293394 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:54.293306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerStarted","Data":"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880"} Jul 08 18:18:54.324521 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:54.324453 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.8513962309999998 podStartE2EDuration="5.324433891s" totalImagesPullingTime="3.457451348s" totalInitContainerRuntime="15.586312ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:54.322331809 +0000 UTC m=+147.064400356" watchObservedRunningTime="2026-07-08 18:18:54.324433891 +0000 UTC m=+147.066502443" Jul 08 18:18:55.299093 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:55.299054 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" event={"ID":"00af267f-eca4-4323-bb0f-968c9b7a42b7","Type":"ContainerStarted","Data":"f77a1a9e5ecb16ec9a7a77072ca1c16fb063dde12cdbaef6f32b236573afa1f8"} Jul 08 18:18:55.299561 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:55.299230 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:55.300897 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:55.300869 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-74867df568-vlntv" event={"ID":"706f152f-285e-4b09-8256-6fc9f5902685","Type":"ContainerStarted","Data":"e4e50add3b36e127be0016c0b1ea90563d2eb6b94ac1b426ce21438ab529247e"} Jul 08 18:18:55.304306 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:55.304284 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" Jul 08 18:18:55.319797 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:55.319742 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5x7mr" podStartSLOduration=1.832537855 podStartE2EDuration="3.319729756s" totalImagesPullingTime="1.487191901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:55.318294854 +0000 UTC m=+148.060363399" watchObservedRunningTime="2026-07-08 18:18:55.319729756 +0000 UTC m=+148.061798343" Jul 08 18:18:55.341104 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:55.341063 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-74867df568-vlntv" podStartSLOduration=1.932700743 podStartE2EDuration="3.341048431s" totalImagesPullingTime="1.408347688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:18:55.340348395 +0000 UTC m=+148.082416969" watchObservedRunningTime="2026-07-08 18:18:55.341048431 +0000 UTC m=+148.083116983" Jul 08 18:18:56.104396 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.104367 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-58zhj"] Jul 08 18:18:56.110103 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.110084 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-58zhj" Jul 08 18:18:56.113082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.113064 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 18:18:56.113165 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.113077 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hlgmv\"" Jul 08 18:18:56.113165 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.113090 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 18:18:56.126326 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.126307 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-58zhj"] Jul 08 18:18:56.192350 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.192328 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb8m6\" (UniqueName: \"kubernetes.io/projected/3a2e2727-d083-4200-ab55-f2dc2bb9db7f-kube-api-access-pb8m6\") pod \"downloads-685bfb5f64-58zhj\" (UID: \"3a2e2727-d083-4200-ab55-f2dc2bb9db7f\") " pod="openshift-console/downloads-685bfb5f64-58zhj" Jul 08 18:18:56.293224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.293199 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb8m6\" (UniqueName: \"kubernetes.io/projected/3a2e2727-d083-4200-ab55-f2dc2bb9db7f-kube-api-access-pb8m6\") pod \"downloads-685bfb5f64-58zhj\" (UID: \"3a2e2727-d083-4200-ab55-f2dc2bb9db7f\") " pod="openshift-console/downloads-685bfb5f64-58zhj" Jul 08 18:18:56.301861 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.301837 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb8m6\" (UniqueName: \"kubernetes.io/projected/3a2e2727-d083-4200-ab55-f2dc2bb9db7f-kube-api-access-pb8m6\") pod \"downloads-685bfb5f64-58zhj\" (UID: \"3a2e2727-d083-4200-ab55-f2dc2bb9db7f\") " pod="openshift-console/downloads-685bfb5f64-58zhj" Jul 08 18:18:56.419195 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.419175 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-58zhj" Jul 08 18:18:56.547569 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:56.547548 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-58zhj"] Jul 08 18:18:56.549605 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:18:56.549577 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2e2727_d083_4200_ab55_f2dc2bb9db7f.slice/crio-6d448baf32fae99d087ef09938fb25e4c4db23fe6d924ee97aa0cd1d9d76c49d WatchSource:0}: Error finding container 6d448baf32fae99d087ef09938fb25e4c4db23fe6d924ee97aa0cd1d9d76c49d: Status 404 returned error can't find the container with id 6d448baf32fae99d087ef09938fb25e4c4db23fe6d924ee97aa0cd1d9d76c49d Jul 08 18:18:57.311983 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:18:57.311941 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-58zhj" event={"ID":"3a2e2727-d083-4200-ab55-f2dc2bb9db7f","Type":"ContainerStarted","Data":"6d448baf32fae99d087ef09938fb25e4c4db23fe6d924ee97aa0cd1d9d76c49d"} Jul 08 18:19:03.815670 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.815629 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b645bb8bf-xp6qr"] Jul 08 18:19:03.823711 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.823690 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.828216 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.827828 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 18:19:03.828216 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.827985 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 18:19:03.828216 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.828196 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 18:19:03.828463 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.828400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 18:19:03.828625 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.828609 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 18:19:03.828826 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.828812 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-ncbtr\"" Jul 08 18:19:03.829125 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.829099 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b645bb8bf-xp6qr"] Jul 08 18:19:03.854080 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.854058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-config\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.854201 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.854093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-serving-cert\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.854201 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.854121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-service-ca\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.854201 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.854162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-oauth-serving-cert\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.854201 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.854193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2j7\" (UniqueName: \"kubernetes.io/projected/0401deb5-c082-4177-9ea5-77ce66a52f2d-kube-api-access-jg2j7\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.854423 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.854213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-oauth-config\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.955396 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.955376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2j7\" (UniqueName: \"kubernetes.io/projected/0401deb5-c082-4177-9ea5-77ce66a52f2d-kube-api-access-jg2j7\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.955518 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.955405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-oauth-config\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.955518 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.955468 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-config\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.955518 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.955502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-serving-cert\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.955697 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.955521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-service-ca\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.955697 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.955579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-oauth-serving-cert\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.956318 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.956247 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-config\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.956419 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.956344 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-oauth-serving-cert\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.956485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.956449 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-service-ca\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.958350 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.958327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-oauth-config\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.958525 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.958507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-serving-cert\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:03.963389 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:03.963360 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2j7\" (UniqueName: \"kubernetes.io/projected/0401deb5-c082-4177-9ea5-77ce66a52f2d-kube-api-access-jg2j7\") pod \"console-7b645bb8bf-xp6qr\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:04.136470 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:04.136450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:04.285499 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:04.285469 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b645bb8bf-xp6qr"] Jul 08 18:19:04.288813 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:19:04.288788 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0401deb5_c082_4177_9ea5_77ce66a52f2d.slice/crio-407d7d03959c0c298b8b0e23158cdeb023f41f5eec9e9ec10340a542ec954c31 WatchSource:0}: Error finding container 407d7d03959c0c298b8b0e23158cdeb023f41f5eec9e9ec10340a542ec954c31: Status 404 returned error can't find the container with id 407d7d03959c0c298b8b0e23158cdeb023f41f5eec9e9ec10340a542ec954c31 Jul 08 18:19:04.341491 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:04.341454 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b645bb8bf-xp6qr" event={"ID":"0401deb5-c082-4177-9ea5-77ce66a52f2d","Type":"ContainerStarted","Data":"407d7d03959c0c298b8b0e23158cdeb023f41f5eec9e9ec10340a542ec954c31"} Jul 08 18:19:08.361513 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:08.361432 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b645bb8bf-xp6qr" event={"ID":"0401deb5-c082-4177-9ea5-77ce66a52f2d","Type":"ContainerStarted","Data":"e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2"} Jul 08 18:19:08.379080 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:08.379020 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b645bb8bf-xp6qr" podStartSLOduration=1.76162121 podStartE2EDuration="5.379001384s" totalImagesPullingTime="3.617380174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:19:08.377989467 +0000 UTC m=+161.120058031" watchObservedRunningTime="2026-07-08 18:19:08.379001384 +0000 UTC m=+161.121069936" Jul 08 18:19:08.671096 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:19:08.671049 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wds7g" podUID="8a1b82f5-714f-41d9-84f0-028fd0eacd6d" Jul 08 18:19:09.366092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:09.366019 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wds7g" Jul 08 18:19:11.399689 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.399651 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7759d5f9c7-xbh4t"] Jul 08 18:19:11.404265 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.404237 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.413059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.413028 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7759d5f9c7-xbh4t"] Jul 08 18:19:11.413162 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.413044 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 18:19:11.521470 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.521432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-serving-cert\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.521657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.521498 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6tw\" (UniqueName: \"kubernetes.io/projected/68f99723-6799-44c6-8b7f-773f14f0da46-kube-api-access-wr6tw\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.521657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.521534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-service-ca\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.521657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.521583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-trusted-ca-bundle\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.521657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.521632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-console-config\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.521657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.521652 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-oauth-serving-cert\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.521872 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.521680 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-oauth-config\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.622868 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.622830 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-service-ca\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623056 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.622875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-trusted-ca-bundle\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623056 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.622902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-console-config\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623056 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.622918 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-oauth-serving-cert\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623056 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.622950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-oauth-config\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623056 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.623045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-serving-cert\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.623108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6tw\" (UniqueName: \"kubernetes.io/projected/68f99723-6799-44c6-8b7f-773f14f0da46-kube-api-access-wr6tw\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623682 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.623623 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-service-ca\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623801 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.623765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-console-config\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623860 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.623812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-oauth-serving-cert\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.623860 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.623838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-trusted-ca-bundle\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.625732 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.625701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-oauth-config\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.625982 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.625958 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-serving-cert\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.631321 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.631295 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6tw\" (UniqueName: \"kubernetes.io/projected/68f99723-6799-44c6-8b7f-773f14f0da46-kube-api-access-wr6tw\") pod \"console-7759d5f9c7-xbh4t\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:11.716323 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:11.716225 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:12.725251 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:12.725221 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:19:12.725769 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:12.725303 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:19:13.542595 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:13.542557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:19:13.545245 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:13.545224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a1b82f5-714f-41d9-84f0-028fd0eacd6d-metrics-tls\") pod \"dns-default-wds7g\" (UID: \"8a1b82f5-714f-41d9-84f0-028fd0eacd6d\") " pod="openshift-dns/dns-default-wds7g" Jul 08 18:19:13.570255 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:13.570224 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d7khc\"" Jul 08 18:19:13.578242 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:13.578213 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wds7g" Jul 08 18:19:14.137404 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:14.137363 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:14.137863 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:14.137429 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:14.143506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:14.143478 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:14.391951 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:14.391881 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:16.420936 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:16.420909 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wds7g"] Jul 08 18:19:16.424414 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:19:16.424379 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1b82f5_714f_41d9_84f0_028fd0eacd6d.slice/crio-65018dce6913153e42ea3a4458a5572bf51e7b8894663b7305fceeba5ccb5a29 WatchSource:0}: Error finding container 65018dce6913153e42ea3a4458a5572bf51e7b8894663b7305fceeba5ccb5a29: Status 404 returned error can't find the container with id 65018dce6913153e42ea3a4458a5572bf51e7b8894663b7305fceeba5ccb5a29 Jul 08 18:19:16.451143 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:16.451120 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7759d5f9c7-xbh4t"] Jul 08 18:19:16.453047 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:19:16.453019 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f99723_6799_44c6_8b7f_773f14f0da46.slice/crio-43ded0ca3c017d2c77a7c7b2bbf5c7da30adcfda777e1fa7bfca3838e8bc73ac WatchSource:0}: Error finding container 43ded0ca3c017d2c77a7c7b2bbf5c7da30adcfda777e1fa7bfca3838e8bc73ac: Status 404 returned error can't find the container with id 43ded0ca3c017d2c77a7c7b2bbf5c7da30adcfda777e1fa7bfca3838e8bc73ac Jul 08 18:19:17.409195 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.409117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wds7g" event={"ID":"8a1b82f5-714f-41d9-84f0-028fd0eacd6d","Type":"ContainerStarted","Data":"65018dce6913153e42ea3a4458a5572bf51e7b8894663b7305fceeba5ccb5a29"} Jul 08 18:19:17.411765 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.411725 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759d5f9c7-xbh4t" event={"ID":"68f99723-6799-44c6-8b7f-773f14f0da46","Type":"ContainerStarted","Data":"0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466"} Jul 08 18:19:17.411943 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.411806 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759d5f9c7-xbh4t" event={"ID":"68f99723-6799-44c6-8b7f-773f14f0da46","Type":"ContainerStarted","Data":"43ded0ca3c017d2c77a7c7b2bbf5c7da30adcfda777e1fa7bfca3838e8bc73ac"} Jul 08 18:19:17.415538 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.415513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-58zhj" event={"ID":"3a2e2727-d083-4200-ab55-f2dc2bb9db7f","Type":"ContainerStarted","Data":"eb4d5938ee989504e7e8f3d9613f336df4a191b786d00b02bb126d87d625ac1e"} Jul 08 18:19:17.416036 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.415991 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-58zhj" Jul 08 18:19:17.426407 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.426377 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-58zhj" Jul 08 18:19:17.429744 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.429693 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7759d5f9c7-xbh4t" podStartSLOduration=6.429678441 podStartE2EDuration="6.429678441s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:19:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:19:17.42872523 +0000 UTC m=+170.170793782" watchObservedRunningTime="2026-07-08 18:19:17.429678441 +0000 UTC m=+170.171746991" Jul 08 18:19:17.446522 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:17.446088 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-58zhj" podStartSLOduration=1.62905274 podStartE2EDuration="21.446067222s" totalImagesPullingTime="19.817014482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:18:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:19:17.444083552 +0000 UTC m=+170.186152210" watchObservedRunningTime="2026-07-08 18:19:17.446067222 +0000 UTC m=+170.188135772" Jul 08 18:19:19.427200 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:19.427111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wds7g" event={"ID":"8a1b82f5-714f-41d9-84f0-028fd0eacd6d","Type":"ContainerStarted","Data":"4345288ff34ad572febe2952d91b06f374e14f5599e9abbd343a649bf3740446"} Jul 08 18:19:19.427682 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:19.427216 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wds7g" event={"ID":"8a1b82f5-714f-41d9-84f0-028fd0eacd6d","Type":"ContainerStarted","Data":"a8fde92bd7c079ebc7f40d551e87c11958b148396ccb049127cdb170026cc10a"} Jul 08 18:19:19.427682 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:19.427359 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wds7g" Jul 08 18:19:19.445326 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:19.445206 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wds7g" podStartSLOduration=131.94984575 podStartE2EDuration="2m14.445186807s" totalImagesPullingTime="2.495341057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:19:19.44379582 +0000 UTC m=+172.185864396" watchObservedRunningTime="2026-07-08 18:19:19.445186807 +0000 UTC m=+172.187255357" Jul 08 18:19:21.716602 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:21.716564 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:21.717064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:21.716651 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:21.721852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:21.721828 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:22.442689 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:22.442654 2558 generic.go:356] "Generic (PLEG): container finished" podID="9944ec00-1b64-4f4c-be5f-80cec2932efa" containerID="f24cbb31993a466d5be66a247ad224b6c1f83a6e22bf3d577261a19e063a879e" exitCode=0 Jul 08 18:19:22.442869 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:22.442735 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" event={"ID":"9944ec00-1b64-4f4c-be5f-80cec2932efa","Type":"ContainerDied","Data":"f24cbb31993a466d5be66a247ad224b6c1f83a6e22bf3d577261a19e063a879e"} Jul 08 18:19:22.443243 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:22.443220 2558 scope.go:117] "RemoveContainer" containerID="f24cbb31993a466d5be66a247ad224b6c1f83a6e22bf3d577261a19e063a879e" Jul 08 18:19:22.447479 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:22.447458 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:19:22.499892 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:22.499222 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b645bb8bf-xp6qr"] Jul 08 18:19:23.451712 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:23.451652 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-4p7p6" event={"ID":"9944ec00-1b64-4f4c-be5f-80cec2932efa","Type":"ContainerStarted","Data":"f4474bf4e4373182f50d58a691201ab62ade037ea8e5aeebb1e9778d3bdbfa88"} Jul 08 18:19:23.466844 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:23.466816 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c64ff6f99-qbpjr_11f0ca37-6215-4ef3-a483-c03c45e378a7/router/0.log" Jul 08 18:19:23.473641 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:23.473597 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hns8x_b80889e9-89bc-4dc2-bb97-bfa43ad97565/serve-healthcheck-canary/0.log" Jul 08 18:19:27.470017 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:27.469986 2558 generic.go:356] "Generic (PLEG): container finished" podID="9766cb00-bb63-41bb-b441-421900ea1fc7" containerID="c510d48259a25ad3ee93da16afa69b1b5972b6d2e8f6ce95a92e2734cff698e8" exitCode=0 Jul 08 18:19:27.470430 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:27.470062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" event={"ID":"9766cb00-bb63-41bb-b441-421900ea1fc7","Type":"ContainerDied","Data":"c510d48259a25ad3ee93da16afa69b1b5972b6d2e8f6ce95a92e2734cff698e8"} Jul 08 18:19:27.470430 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:27.470384 2558 scope.go:117] "RemoveContainer" containerID="c510d48259a25ad3ee93da16afa69b1b5972b6d2e8f6ce95a92e2734cff698e8" Jul 08 18:19:28.476360 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:28.476316 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-t4w72" event={"ID":"9766cb00-bb63-41bb-b441-421900ea1fc7","Type":"ContainerStarted","Data":"51a19549aebf1f6e66883b22bf30fcffb5add6fd818caadb8619f8c988c79266"} Jul 08 18:19:29.433748 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:29.433723 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wds7g" Jul 08 18:19:32.729800 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:32.729768 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:19:32.734032 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:32.733998 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-74867df568-vlntv" Jul 08 18:19:47.530831 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.530770 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b645bb8bf-xp6qr" podUID="0401deb5-c082-4177-9ea5-77ce66a52f2d" containerName="console" containerID="cri-o://e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2" gracePeriod=15 Jul 08 18:19:47.817450 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.817424 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:47.840362 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840330 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-oauth-config\") pod \"0401deb5-c082-4177-9ea5-77ce66a52f2d\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " Jul 08 18:19:47.840528 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840382 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-oauth-serving-cert\") pod \"0401deb5-c082-4177-9ea5-77ce66a52f2d\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " Jul 08 18:19:47.840528 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840432 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg2j7\" (UniqueName: \"kubernetes.io/projected/0401deb5-c082-4177-9ea5-77ce66a52f2d-kube-api-access-jg2j7\") pod \"0401deb5-c082-4177-9ea5-77ce66a52f2d\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " Jul 08 18:19:47.840528 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840516 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-config\") pod \"0401deb5-c082-4177-9ea5-77ce66a52f2d\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " Jul 08 18:19:47.840685 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840545 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-serving-cert\") pod \"0401deb5-c082-4177-9ea5-77ce66a52f2d\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " Jul 08 18:19:47.840685 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840573 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-service-ca\") pod \"0401deb5-c082-4177-9ea5-77ce66a52f2d\" (UID: \"0401deb5-c082-4177-9ea5-77ce66a52f2d\") " Jul 08 18:19:47.840854 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840805 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0401deb5-c082-4177-9ea5-77ce66a52f2d" (UID: "0401deb5-c082-4177-9ea5-77ce66a52f2d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:19:47.840941 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.840845 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-config" (OuterVolumeSpecName: "console-config") pod "0401deb5-c082-4177-9ea5-77ce66a52f2d" (UID: "0401deb5-c082-4177-9ea5-77ce66a52f2d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:19:47.841172 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.841151 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-service-ca" (OuterVolumeSpecName: "service-ca") pod "0401deb5-c082-4177-9ea5-77ce66a52f2d" (UID: "0401deb5-c082-4177-9ea5-77ce66a52f2d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:19:47.843214 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.843176 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0401deb5-c082-4177-9ea5-77ce66a52f2d-kube-api-access-jg2j7" (OuterVolumeSpecName: "kube-api-access-jg2j7") pod "0401deb5-c082-4177-9ea5-77ce66a52f2d" (UID: "0401deb5-c082-4177-9ea5-77ce66a52f2d"). InnerVolumeSpecName "kube-api-access-jg2j7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:19:47.843214 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.843199 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0401deb5-c082-4177-9ea5-77ce66a52f2d" (UID: "0401deb5-c082-4177-9ea5-77ce66a52f2d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:19:47.843390 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.843289 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0401deb5-c082-4177-9ea5-77ce66a52f2d" (UID: "0401deb5-c082-4177-9ea5-77ce66a52f2d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:19:47.941537 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.941503 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:19:47.941537 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.941531 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:19:47.941537 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.941541 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:19:47.941765 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.941550 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0401deb5-c082-4177-9ea5-77ce66a52f2d-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:19:47.941765 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.941558 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0401deb5-c082-4177-9ea5-77ce66a52f2d-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:19:47.941765 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:47.941567 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg2j7\" (UniqueName: \"kubernetes.io/projected/0401deb5-c082-4177-9ea5-77ce66a52f2d-kube-api-access-jg2j7\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:19:48.557969 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.557933 2558 generic.go:356] "Generic (PLEG): container finished" podID="0401deb5-c082-4177-9ea5-77ce66a52f2d" containerID="e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2" exitCode=0 Jul 08 18:19:48.558504 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.557996 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b645bb8bf-xp6qr" Jul 08 18:19:48.558504 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.558022 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b645bb8bf-xp6qr" event={"ID":"0401deb5-c082-4177-9ea5-77ce66a52f2d","Type":"ContainerDied","Data":"e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2"} Jul 08 18:19:48.558504 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.558091 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b645bb8bf-xp6qr" event={"ID":"0401deb5-c082-4177-9ea5-77ce66a52f2d","Type":"ContainerDied","Data":"407d7d03959c0c298b8b0e23158cdeb023f41f5eec9e9ec10340a542ec954c31"} Jul 08 18:19:48.558504 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.558117 2558 scope.go:117] "RemoveContainer" containerID="e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2" Jul 08 18:19:48.568057 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.568041 2558 scope.go:117] "RemoveContainer" containerID="e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2" Jul 08 18:19:48.568395 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:19:48.568374 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2\": container with ID starting with e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2 not found: ID does not exist" containerID="e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2" Jul 08 18:19:48.568452 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.568404 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2"} err="failed to get container status \"e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2\": rpc error: code = NotFound desc = could not find container \"e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2\": container with ID starting with e2e2984673edee6e3b2227b6a56a099e39f5f56542b91d048ba4e358322357d2 not found: ID does not exist" Jul 08 18:19:48.579707 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.579684 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b645bb8bf-xp6qr"] Jul 08 18:19:48.583068 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:48.583046 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b645bb8bf-xp6qr"] Jul 08 18:19:49.728663 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:19:49.728631 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0401deb5-c082-4177-9ea5-77ce66a52f2d" path="/var/lib/kubelet/pods/0401deb5-c082-4177-9ea5-77ce66a52f2d/volumes" Jul 08 18:20:08.281905 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:08.281869 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:20:08.642554 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:08.642510 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="alertmanager" containerID="cri-o://5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4" gracePeriod=120 Jul 08 18:20:08.642753 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:08.642581 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-metric" containerID="cri-o://56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a" gracePeriod=120 Jul 08 18:20:08.642753 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:08.642592 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy" containerID="cri-o://b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2" gracePeriod=120 Jul 08 18:20:08.642753 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:08.642617 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="prom-label-proxy" containerID="cri-o://63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880" gracePeriod=120 Jul 08 18:20:08.642753 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:08.642585 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-web" containerID="cri-o://be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43" gracePeriod=120 Jul 08 18:20:08.642753 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:08.642589 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="config-reloader" containerID="cri-o://152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa" gracePeriod=120 Jul 08 18:20:09.651144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651110 2558 generic.go:356] "Generic (PLEG): container finished" podID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerID="63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880" exitCode=0 Jul 08 18:20:09.651144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651138 2558 generic.go:356] "Generic (PLEG): container finished" podID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerID="b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2" exitCode=0 Jul 08 18:20:09.651144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651146 2558 generic.go:356] "Generic (PLEG): container finished" podID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerID="152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa" exitCode=0 Jul 08 18:20:09.651144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651153 2558 generic.go:356] "Generic (PLEG): container finished" podID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerID="5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4" exitCode=0 Jul 08 18:20:09.651641 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651180 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880"} Jul 08 18:20:09.651641 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2"} Jul 08 18:20:09.651641 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa"} Jul 08 18:20:09.651641 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.651365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4"} Jul 08 18:20:09.891485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:09.891461 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.020301 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020208 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-web-config\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020301 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020240 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-metrics-client-ca\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020301 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020261 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020335 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wvqh6\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-kube-api-access-wvqh6\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020377 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020406 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-trusted-ca-bundle\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020435 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-web\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020477 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-main-tls\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020507 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-cluster-tls-config\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020532 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-out\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020576 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-tls-assets\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020978 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020577 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:10.020978 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020614 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-volume\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020978 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020652 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-main-db\") pod \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\" (UID: \"aac9500f-438c-46c0-a38d-ea34f6ba1c7f\") " Jul 08 18:20:10.020978 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.020809 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:10.021190 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.021081 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-metrics-client-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.021190 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.021107 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.021190 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.021084 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:20:10.023347 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.023305 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:10.023617 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.023562 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:20:10.024419 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.024304 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:10.024495 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.024413 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-kube-api-access-wvqh6" (OuterVolumeSpecName: "kube-api-access-wvqh6") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "kube-api-access-wvqh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:20:10.025022 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.024987 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-volume" (OuterVolumeSpecName: "config-volume") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:10.025107 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.025071 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:10.025203 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.025182 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-out" (OuterVolumeSpecName: "config-out") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:20:10.025350 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.025328 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:10.029085 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.029063 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:10.035161 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.035140 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-web-config" (OuterVolumeSpecName: "web-config") pod "aac9500f-438c-46c0-a38d-ea34f6ba1c7f" (UID: "aac9500f-438c-46c0-a38d-ea34f6ba1c7f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:10.122464 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122430 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122464 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122465 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-main-tls\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122476 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-cluster-tls-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122485 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-out\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122493 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-tls-assets\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122500 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-config-volume\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122508 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-alertmanager-main-db\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122516 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-web-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122523 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122531 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wvqh6\" (UniqueName: \"kubernetes.io/projected/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-kube-api-access-wvqh6\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.122587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.122539 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aac9500f-438c-46c0-a38d-ea34f6ba1c7f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:10.659164 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.659133 2558 generic.go:356] "Generic (PLEG): container finished" podID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerID="56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a" exitCode=0 Jul 08 18:20:10.659164 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.659161 2558 generic.go:356] "Generic (PLEG): container finished" podID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerID="be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43" exitCode=0 Jul 08 18:20:10.659640 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.659201 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a"} Jul 08 18:20:10.659640 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.659212 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.659640 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.659301 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43"} Jul 08 18:20:10.659640 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.659350 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aac9500f-438c-46c0-a38d-ea34f6ba1c7f","Type":"ContainerDied","Data":"7366427e9f9a3e31f46427ed4934781615b3862c35a41f91c8689d40e7391ed2"} Jul 08 18:20:10.659640 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.659377 2558 scope.go:117] "RemoveContainer" containerID="63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880" Jul 08 18:20:10.668009 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.667993 2558 scope.go:117] "RemoveContainer" containerID="56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a" Jul 08 18:20:10.675671 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.675654 2558 scope.go:117] "RemoveContainer" containerID="b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2" Jul 08 18:20:10.683112 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.683053 2558 scope.go:117] "RemoveContainer" containerID="be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43" Jul 08 18:20:10.684001 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.683980 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:20:10.691862 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.691843 2558 scope.go:117] "RemoveContainer" containerID="152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa" Jul 08 18:20:10.694774 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.694753 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:20:10.699848 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.699825 2558 scope.go:117] "RemoveContainer" containerID="5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4" Jul 08 18:20:10.706577 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.706559 2558 scope.go:117] "RemoveContainer" containerID="e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23" Jul 08 18:20:10.713380 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.713352 2558 scope.go:117] "RemoveContainer" containerID="63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880" Jul 08 18:20:10.713604 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:10.713587 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880\": container with ID starting with 63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880 not found: ID does not exist" containerID="63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880" Jul 08 18:20:10.713653 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.713613 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880"} err="failed to get container status \"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880\": rpc error: code = NotFound desc = could not find container \"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880\": container with ID starting with 63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880 not found: ID does not exist" Jul 08 18:20:10.713653 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.713630 2558 scope.go:117] "RemoveContainer" containerID="56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a" Jul 08 18:20:10.713812 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:10.713793 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a\": container with ID starting with 56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a not found: ID does not exist" containerID="56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a" Jul 08 18:20:10.713880 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.713822 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a"} err="failed to get container status \"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a\": rpc error: code = NotFound desc = could not find container \"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a\": container with ID starting with 56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a not found: ID does not exist" Jul 08 18:20:10.713880 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.713844 2558 scope.go:117] "RemoveContainer" containerID="b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2" Jul 08 18:20:10.714082 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:10.714065 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2\": container with ID starting with b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2 not found: ID does not exist" containerID="b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2" Jul 08 18:20:10.714125 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714086 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2"} err="failed to get container status \"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2\": rpc error: code = NotFound desc = could not find container \"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2\": container with ID starting with b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2 not found: ID does not exist" Jul 08 18:20:10.714125 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714100 2558 scope.go:117] "RemoveContainer" containerID="be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43" Jul 08 18:20:10.714328 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:10.714308 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43\": container with ID starting with be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43 not found: ID does not exist" containerID="be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43" Jul 08 18:20:10.714381 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714331 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43"} err="failed to get container status \"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43\": rpc error: code = NotFound desc = could not find container \"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43\": container with ID starting with be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43 not found: ID does not exist" Jul 08 18:20:10.714381 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714344 2558 scope.go:117] "RemoveContainer" containerID="152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa" Jul 08 18:20:10.714551 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:10.714535 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa\": container with ID starting with 152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa not found: ID does not exist" containerID="152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa" Jul 08 18:20:10.714614 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714558 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa"} err="failed to get container status \"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa\": rpc error: code = NotFound desc = could not find container \"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa\": container with ID starting with 152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa not found: ID does not exist" Jul 08 18:20:10.714614 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714578 2558 scope.go:117] "RemoveContainer" containerID="5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4" Jul 08 18:20:10.714791 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:10.714772 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4\": container with ID starting with 5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4 not found: ID does not exist" containerID="5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4" Jul 08 18:20:10.714852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714799 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4"} err="failed to get container status \"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4\": rpc error: code = NotFound desc = could not find container \"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4\": container with ID starting with 5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4 not found: ID does not exist" Jul 08 18:20:10.714852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.714818 2558 scope.go:117] "RemoveContainer" containerID="e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23" Jul 08 18:20:10.715028 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:10.715010 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23\": container with ID starting with e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23 not found: ID does not exist" containerID="e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23" Jul 08 18:20:10.715067 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715033 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23"} err="failed to get container status \"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23\": rpc error: code = NotFound desc = could not find container \"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23\": container with ID starting with e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23 not found: ID does not exist" Jul 08 18:20:10.715067 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715047 2558 scope.go:117] "RemoveContainer" containerID="63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880" Jul 08 18:20:10.715322 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715303 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880"} err="failed to get container status \"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880\": rpc error: code = NotFound desc = could not find container \"63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880\": container with ID starting with 63d9e4fc6d593b0bdeba849d86cfb2c221b2a1a438bc52e357ed7852036ba880 not found: ID does not exist" Jul 08 18:20:10.715397 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715323 2558 scope.go:117] "RemoveContainer" containerID="56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a" Jul 08 18:20:10.715539 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715524 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a"} err="failed to get container status \"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a\": rpc error: code = NotFound desc = could not find container \"56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a\": container with ID starting with 56a081ae37cbb18cd6c90378b97d75040150995e79719e763082355c6271041a not found: ID does not exist" Jul 08 18:20:10.715604 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715541 2558 scope.go:117] "RemoveContainer" containerID="b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2" Jul 08 18:20:10.715757 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715736 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2"} err="failed to get container status \"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2\": rpc error: code = NotFound desc = could not find container \"b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2\": container with ID starting with b0757e4c0960cbdd52892c2577793bf9c800953784c95abe4c5a6b8054cd61d2 not found: ID does not exist" Jul 08 18:20:10.715812 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715759 2558 scope.go:117] "RemoveContainer" containerID="be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43" Jul 08 18:20:10.715959 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715941 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43"} err="failed to get container status \"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43\": rpc error: code = NotFound desc = could not find container \"be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43\": container with ID starting with be1a744c050dcb73e40e8b14368efc3e4e7818cb0045c7cc3ae6a456acb62d43 not found: ID does not exist" Jul 08 18:20:10.716006 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.715960 2558 scope.go:117] "RemoveContainer" containerID="152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa" Jul 08 18:20:10.716207 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.716190 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa"} err="failed to get container status \"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa\": rpc error: code = NotFound desc = could not find container \"152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa\": container with ID starting with 152492adf74f5914a14476e18c7a6ad5f90be14b4fd68769756253d86b6675fa not found: ID does not exist" Jul 08 18:20:10.716316 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.716209 2558 scope.go:117] "RemoveContainer" containerID="5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4" Jul 08 18:20:10.716471 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.716454 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4"} err="failed to get container status \"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4\": rpc error: code = NotFound desc = could not find container \"5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4\": container with ID starting with 5ba18cb2e9fc136988bcfe74b8737f699798f5c4d0b97373ea01ddc32c22c6d4 not found: ID does not exist" Jul 08 18:20:10.716538 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.716472 2558 scope.go:117] "RemoveContainer" containerID="e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23" Jul 08 18:20:10.716713 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.716697 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23"} err="failed to get container status \"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23\": rpc error: code = NotFound desc = could not find container \"e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23\": container with ID starting with e37bb448962009bdef040f0587f2de46af53ee579d28a56786eae37bf1708f23 not found: ID does not exist" Jul 08 18:20:10.753969 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.753942 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:20:10.754257 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754241 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0401deb5-c082-4177-9ea5-77ce66a52f2d" containerName="console" Jul 08 18:20:10.754354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754259 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0401deb5-c082-4177-9ea5-77ce66a52f2d" containerName="console" Jul 08 18:20:10.754354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754294 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="config-reloader" Jul 08 18:20:10.754354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754303 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="config-reloader" Jul 08 18:20:10.754354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754316 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-web" Jul 08 18:20:10.754354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754325 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-web" Jul 08 18:20:10.754354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754338 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="prom-label-proxy" Jul 08 18:20:10.754354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754346 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="prom-label-proxy" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754363 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="alertmanager" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754371 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="alertmanager" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754381 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754390 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754403 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="init-config-reloader" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754410 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="init-config-reloader" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754422 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-metric" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754431 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-metric" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754509 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="alertmanager" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754521 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754531 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-metric" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754541 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="kube-rbac-proxy-web" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754550 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="config-reloader" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754559 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" containerName="prom-label-proxy" Jul 08 18:20:10.754687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.754568 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0401deb5-c082-4177-9ea5-77ce66a52f2d" containerName="console" Jul 08 18:20:10.758739 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.758722 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761297 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761339 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761347 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761361 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761376 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761412 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qzdqh\"" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761377 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 18:20:10.761498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761321 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 18:20:10.761920 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.761906 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 18:20:10.766506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.766484 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 18:20:10.773186 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.773166 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:20:10.826874 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.826856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a9d787d-da08-4d77-a591-201b25e4d403-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.826976 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.826921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b747h\" (UniqueName: \"kubernetes.io/projected/1a9d787d-da08-4d77-a591-201b25e4d403-kube-api-access-b747h\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.826976 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.826943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827063 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.826993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827063 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9d787d-da08-4d77-a591-201b25e4d403-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827148 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827087 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827148 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827117 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827148 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827332 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a9d787d-da08-4d77-a591-201b25e4d403-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827332 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827175 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-web-config\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827332 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a9d787d-da08-4d77-a591-201b25e4d403-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827332 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827293 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.827481 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.827357 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a9d787d-da08-4d77-a591-201b25e4d403-config-out\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.927708 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927654 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a9d787d-da08-4d77-a591-201b25e4d403-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.927708 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927695 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b747h\" (UniqueName: \"kubernetes.io/projected/1a9d787d-da08-4d77-a591-201b25e4d403-kube-api-access-b747h\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.927856 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.927856 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.927856 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927786 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9d787d-da08-4d77-a591-201b25e4d403-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.927856 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.927856 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927870 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927900 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a9d787d-da08-4d77-a591-201b25e4d403-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-web-config\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.927955 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a9d787d-da08-4d77-a591-201b25e4d403-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.928007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.928046 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a9d787d-da08-4d77-a591-201b25e4d403-config-out\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.928085 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1a9d787d-da08-4d77-a591-201b25e4d403-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.928840 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.928537 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1a9d787d-da08-4d77-a591-201b25e4d403-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.929135 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.929110 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a9d787d-da08-4d77-a591-201b25e4d403-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.930866 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.930838 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1a9d787d-da08-4d77-a591-201b25e4d403-config-out\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.930973 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.930885 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.931031 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.930979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-web-config\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.931217 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.931196 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.931471 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.931452 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.931554 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.931514 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.931554 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.931528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.931827 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.931812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1a9d787d-da08-4d77-a591-201b25e4d403-config-volume\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.932443 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.932429 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1a9d787d-da08-4d77-a591-201b25e4d403-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:10.935266 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:10.935246 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b747h\" (UniqueName: \"kubernetes.io/projected/1a9d787d-da08-4d77-a591-201b25e4d403-kube-api-access-b747h\") pod \"alertmanager-main-0\" (UID: \"1a9d787d-da08-4d77-a591-201b25e4d403\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:11.067559 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:11.067539 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 18:20:11.201726 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:11.201703 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 18:20:11.204105 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:20:11.204082 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a9d787d_da08_4d77_a591_201b25e4d403.slice/crio-296e345e9a345dc8a18a6e4230eb07a7c1346185dedc29eb2b4bc579efce5317 WatchSource:0}: Error finding container 296e345e9a345dc8a18a6e4230eb07a7c1346185dedc29eb2b4bc579efce5317: Status 404 returned error can't find the container with id 296e345e9a345dc8a18a6e4230eb07a7c1346185dedc29eb2b4bc579efce5317 Jul 08 18:20:11.664864 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:11.664828 2558 generic.go:356] "Generic (PLEG): container finished" podID="1a9d787d-da08-4d77-a591-201b25e4d403" containerID="a3c0341d50dc1a57cf99d66d0e6e5a79ddf1950ed1b9448d17d82866cef81801" exitCode=0 Jul 08 18:20:11.665319 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:11.664916 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerDied","Data":"a3c0341d50dc1a57cf99d66d0e6e5a79ddf1950ed1b9448d17d82866cef81801"} Jul 08 18:20:11.665319 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:11.665053 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerStarted","Data":"296e345e9a345dc8a18a6e4230eb07a7c1346185dedc29eb2b4bc579efce5317"} Jul 08 18:20:11.729144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:11.729113 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac9500f-438c-46c0-a38d-ea34f6ba1c7f" path="/var/lib/kubelet/pods/aac9500f-438c-46c0-a38d-ea34f6ba1c7f/volumes" Jul 08 18:20:12.321255 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.321194 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-779659f955-qjx6z"] Jul 08 18:20:12.324005 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.323989 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.326560 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.326538 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 18:20:12.326714 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.326545 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 18:20:12.326714 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.326545 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 18:20:12.326714 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.326545 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 18:20:12.326973 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.326783 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-v8nrc\"" Jul 08 18:20:12.326973 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.326903 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 18:20:12.331695 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.331667 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 18:20:12.337341 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.337318 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-779659f955-qjx6z"] Jul 08 18:20:12.438862 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.438836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-metrics-client-ca\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.438862 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.438861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.439018 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.438887 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4xfr\" (UniqueName: \"kubernetes.io/projected/79ccc9c3-30e7-489b-aa85-434fa846ecd9-kube-api-access-t4xfr\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.439018 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.438909 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-telemeter-client-tls\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.439018 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.438993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-serving-certs-ca-bundle\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.439124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.439030 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.439124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.439091 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-secret-telemeter-client\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.439124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.439110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-federate-client-tls\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540131 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540104 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4xfr\" (UniqueName: \"kubernetes.io/projected/79ccc9c3-30e7-489b-aa85-434fa846ecd9-kube-api-access-t4xfr\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540249 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-telemeter-client-tls\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540249 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540167 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-serving-certs-ca-bundle\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540249 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540249 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540234 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-secret-telemeter-client\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540315 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-federate-client-tls\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-metrics-client-ca\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.540482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.540374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.541075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.541049 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-serving-certs-ca-bundle\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.541183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.541090 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-metrics-client-ca\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.541546 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.541519 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ccc9c3-30e7-489b-aa85-434fa846ecd9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.542848 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.542821 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-secret-telemeter-client\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.542944 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.542860 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.543092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.543069 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-federate-client-tls\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.543130 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.543069 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79ccc9c3-30e7-489b-aa85-434fa846ecd9-telemeter-client-tls\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.548362 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.548340 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4xfr\" (UniqueName: \"kubernetes.io/projected/79ccc9c3-30e7-489b-aa85-434fa846ecd9-kube-api-access-t4xfr\") pod \"telemeter-client-779659f955-qjx6z\" (UID: \"79ccc9c3-30e7-489b-aa85-434fa846ecd9\") " pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.634580 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.634558 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" Jul 08 18:20:12.674447 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.674418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerStarted","Data":"996a76651bffff38f8ed8226c62abceca8e6b6267d0ef266869b0502a5f16d16"} Jul 08 18:20:12.674791 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.674483 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerStarted","Data":"905bf27e87de0c9b446dde0a2e7728cacad86e151334b43a5977af7286ed254b"} Jul 08 18:20:12.674791 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.674513 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerStarted","Data":"e8d282138355d75fa03e77d19db49da57c44beff8956d98cc79f4bc24905272f"} Jul 08 18:20:12.674791 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.674582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerStarted","Data":"021635a2f4d4a36ca109bf445bb25670f6b622af0f4185762c2037a5a130b750"} Jul 08 18:20:12.674791 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.674614 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerStarted","Data":"7483499cb0c10a888c0e0a9aeb903a6cc82e1d2536c0ce4105315ee40bd45549"} Jul 08 18:20:12.674791 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.674646 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1a9d787d-da08-4d77-a591-201b25e4d403","Type":"ContainerStarted","Data":"edaeae609eaf3e5d7e75c6812f46b1ba5681eabb14e6e761d0bf4960cddee250"} Jul 08 18:20:12.707997 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.707354 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.692369613 podStartE2EDuration="2.707332887s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.963274ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:20:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:20:12.706351739 +0000 UTC m=+225.448420315" watchObservedRunningTime="2026-07-08 18:20:12.707332887 +0000 UTC m=+225.449401438" Jul 08 18:20:12.780513 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:12.780480 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-779659f955-qjx6z"] Jul 08 18:20:12.783139 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:20:12.783117 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ccc9c3_30e7_489b_aa85_434fa846ecd9.slice/crio-d254e28cc7052f6c10aad1e89663b80730bfff708e1012c0cbb2a90fda781e97 WatchSource:0}: Error finding container d254e28cc7052f6c10aad1e89663b80730bfff708e1012c0cbb2a90fda781e97: Status 404 returned error can't find the container with id d254e28cc7052f6c10aad1e89663b80730bfff708e1012c0cbb2a90fda781e97 Jul 08 18:20:13.680610 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:13.680566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" event={"ID":"79ccc9c3-30e7-489b-aa85-434fa846ecd9","Type":"ContainerStarted","Data":"d254e28cc7052f6c10aad1e89663b80730bfff708e1012c0cbb2a90fda781e97"} Jul 08 18:20:15.692974 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:15.692936 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" event={"ID":"79ccc9c3-30e7-489b-aa85-434fa846ecd9","Type":"ContainerStarted","Data":"12f364fee683e5ed6d8bf67c28b10c4d712880ac5f91465dd397dd760f40d104"} Jul 08 18:20:15.693339 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:15.692994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" event={"ID":"79ccc9c3-30e7-489b-aa85-434fa846ecd9","Type":"ContainerStarted","Data":"21c96c29c9eed7fbe75e14657d5b6dd171df8fdef8f637df73d17602f4c896a3"} Jul 08 18:20:15.693339 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:15.693017 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" event={"ID":"79ccc9c3-30e7-489b-aa85-434fa846ecd9","Type":"ContainerStarted","Data":"aee000adf9610286fcbaa5d58247fba7779718139ffc81e48f57aeb32700d62c"} Jul 08 18:20:15.722328 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:15.722258 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-779659f955-qjx6z" podStartSLOduration=1.21465418 podStartE2EDuration="3.722242722s" totalImagesPullingTime="2.507588542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:20:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:20:15.720528237 +0000 UTC m=+228.462596813" watchObservedRunningTime="2026-07-08 18:20:15.722242722 +0000 UTC m=+228.464311277" Jul 08 18:20:16.492370 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.492339 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-678d45df8b-qmq2g"] Jul 08 18:20:16.494782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.494762 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.507605 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.507577 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678d45df8b-qmq2g"] Jul 08 18:20:16.575357 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.575329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-oauth-config\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.575444 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.575378 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-config\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.575444 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.575405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-oauth-serving-cert\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.575444 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.575425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwlhn\" (UniqueName: \"kubernetes.io/projected/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-kube-api-access-kwlhn\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.575584 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.575444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-trusted-ca-bundle\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.575584 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.575481 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-serving-cert\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.575584 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.575530 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-service-ca\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676031 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.675998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-oauth-config\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-config\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-oauth-serving-cert\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwlhn\" (UniqueName: \"kubernetes.io/projected/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-kube-api-access-kwlhn\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-trusted-ca-bundle\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676382 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-serving-cert\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676382 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-service-ca\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.676940 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-oauth-serving-cert\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.677023 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676954 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-config\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.677023 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.676963 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-service-ca\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.677354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.677327 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-trusted-ca-bundle\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.678675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.678650 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-serving-cert\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.678832 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.678812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-oauth-config\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.686572 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.686543 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwlhn\" (UniqueName: \"kubernetes.io/projected/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-kube-api-access-kwlhn\") pod \"console-678d45df8b-qmq2g\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.804654 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.804603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:16.931553 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:16.931530 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-678d45df8b-qmq2g"] Jul 08 18:20:16.933761 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:20:16.933730 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5596e3_1c4f_4a4f_ad70_91f2ebfcd030.slice/crio-3ee451e533bf404f488617c6e2d1ee23fdac6d6ba838282f15b40cd72b219f5e WatchSource:0}: Error finding container 3ee451e533bf404f488617c6e2d1ee23fdac6d6ba838282f15b40cd72b219f5e: Status 404 returned error can't find the container with id 3ee451e533bf404f488617c6e2d1ee23fdac6d6ba838282f15b40cd72b219f5e Jul 08 18:20:17.710354 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:17.710307 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678d45df8b-qmq2g" event={"ID":"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030","Type":"ContainerStarted","Data":"fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3"} Jul 08 18:20:17.710583 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:17.710410 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678d45df8b-qmq2g" event={"ID":"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030","Type":"ContainerStarted","Data":"3ee451e533bf404f488617c6e2d1ee23fdac6d6ba838282f15b40cd72b219f5e"} Jul 08 18:20:17.728460 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:17.728411 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-678d45df8b-qmq2g" podStartSLOduration=1.7283968939999999 podStartE2EDuration="1.728396894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:20:17.726443775 +0000 UTC m=+230.468512354" watchObservedRunningTime="2026-07-08 18:20:17.728396894 +0000 UTC m=+230.470465733" Jul 08 18:20:26.804721 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:26.804677 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:26.804721 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:26.804733 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:26.809677 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:26.809652 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:27.759701 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:27.759678 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:20:27.808691 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:27.808656 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7759d5f9c7-xbh4t"] Jul 08 18:20:52.835861 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:52.835732 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7759d5f9c7-xbh4t" podUID="68f99723-6799-44c6-8b7f-773f14f0da46" containerName="console" containerID="cri-o://0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466" gracePeriod=15 Jul 08 18:20:53.079086 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.079066 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:20:53.183781 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.183757 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-oauth-serving-cert\") pod \"68f99723-6799-44c6-8b7f-773f14f0da46\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " Jul 08 18:20:53.183919 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.183795 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-serving-cert\") pod \"68f99723-6799-44c6-8b7f-773f14f0da46\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " Jul 08 18:20:53.183919 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.183815 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-service-ca\") pod \"68f99723-6799-44c6-8b7f-773f14f0da46\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " Jul 08 18:20:53.183919 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.183849 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-trusted-ca-bundle\") pod \"68f99723-6799-44c6-8b7f-773f14f0da46\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " Jul 08 18:20:53.183919 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.183871 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr6tw\" (UniqueName: \"kubernetes.io/projected/68f99723-6799-44c6-8b7f-773f14f0da46-kube-api-access-wr6tw\") pod \"68f99723-6799-44c6-8b7f-773f14f0da46\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " Jul 08 18:20:53.183919 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.183905 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-console-config\") pod \"68f99723-6799-44c6-8b7f-773f14f0da46\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " Jul 08 18:20:53.184183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.183934 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-oauth-config\") pod \"68f99723-6799-44c6-8b7f-773f14f0da46\" (UID: \"68f99723-6799-44c6-8b7f-773f14f0da46\") " Jul 08 18:20:53.184183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.184109 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "68f99723-6799-44c6-8b7f-773f14f0da46" (UID: "68f99723-6799-44c6-8b7f-773f14f0da46"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:53.184370 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.184339 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-service-ca" (OuterVolumeSpecName: "service-ca") pod "68f99723-6799-44c6-8b7f-773f14f0da46" (UID: "68f99723-6799-44c6-8b7f-773f14f0da46"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:53.184370 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.184344 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-console-config" (OuterVolumeSpecName: "console-config") pod "68f99723-6799-44c6-8b7f-773f14f0da46" (UID: "68f99723-6799-44c6-8b7f-773f14f0da46"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:53.184557 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.184451 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "68f99723-6799-44c6-8b7f-773f14f0da46" (UID: "68f99723-6799-44c6-8b7f-773f14f0da46"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:20:53.185998 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.185971 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "68f99723-6799-44c6-8b7f-773f14f0da46" (UID: "68f99723-6799-44c6-8b7f-773f14f0da46"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:53.186081 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.185968 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68f99723-6799-44c6-8b7f-773f14f0da46-kube-api-access-wr6tw" (OuterVolumeSpecName: "kube-api-access-wr6tw") pod "68f99723-6799-44c6-8b7f-773f14f0da46" (UID: "68f99723-6799-44c6-8b7f-773f14f0da46"). InnerVolumeSpecName "kube-api-access-wr6tw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:20:53.186081 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.186019 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "68f99723-6799-44c6-8b7f-773f14f0da46" (UID: "68f99723-6799-44c6-8b7f-773f14f0da46"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:20:53.284692 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.284667 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:53.284692 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.284691 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:53.284807 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.284702 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:53.284807 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.284711 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-trusted-ca-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:53.284807 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.284720 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr6tw\" (UniqueName: \"kubernetes.io/projected/68f99723-6799-44c6-8b7f-773f14f0da46-kube-api-access-wr6tw\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:53.284807 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.284729 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/68f99723-6799-44c6-8b7f-773f14f0da46-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:53.284807 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.284737 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/68f99723-6799-44c6-8b7f-773f14f0da46-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:20:53.858117 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.858071 2558 generic.go:356] "Generic (PLEG): container finished" podID="68f99723-6799-44c6-8b7f-773f14f0da46" containerID="0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466" exitCode=0 Jul 08 18:20:53.858485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.858118 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7759d5f9c7-xbh4t" Jul 08 18:20:53.858485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.858154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759d5f9c7-xbh4t" event={"ID":"68f99723-6799-44c6-8b7f-773f14f0da46","Type":"ContainerDied","Data":"0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466"} Jul 08 18:20:53.858485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.858218 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7759d5f9c7-xbh4t" event={"ID":"68f99723-6799-44c6-8b7f-773f14f0da46","Type":"ContainerDied","Data":"43ded0ca3c017d2c77a7c7b2bbf5c7da30adcfda777e1fa7bfca3838e8bc73ac"} Jul 08 18:20:53.858485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.858239 2558 scope.go:117] "RemoveContainer" containerID="0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466" Jul 08 18:20:53.866944 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.866924 2558 scope.go:117] "RemoveContainer" containerID="0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466" Jul 08 18:20:53.867219 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:20:53.867198 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466\": container with ID starting with 0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466 not found: ID does not exist" containerID="0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466" Jul 08 18:20:53.867263 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.867227 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466"} err="failed to get container status \"0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466\": rpc error: code = NotFound desc = could not find container \"0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466\": container with ID starting with 0c37c8a2cc27bebdcdb060a19c1c75bac2e634919f493c7c99ba5c645a4ce466 not found: ID does not exist" Jul 08 18:20:53.873168 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.873144 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7759d5f9c7-xbh4t"] Jul 08 18:20:53.875999 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:53.875977 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7759d5f9c7-xbh4t"] Jul 08 18:20:55.728686 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:20:55.728653 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f99723-6799-44c6-8b7f-773f14f0da46" path="/var/lib/kubelet/pods/68f99723-6799-44c6-8b7f-773f14f0da46/volumes" Jul 08 18:21:23.769247 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.769207 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fd4fcdf68-5p9xc"] Jul 08 18:21:23.769835 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.769686 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f99723-6799-44c6-8b7f-773f14f0da46" containerName="console" Jul 08 18:21:23.769835 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.769706 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f99723-6799-44c6-8b7f-773f14f0da46" containerName="console" Jul 08 18:21:23.769835 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.769791 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f99723-6799-44c6-8b7f-773f14f0da46" containerName="console" Jul 08 18:21:23.771782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.771763 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:23.795371 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.795347 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd4fcdf68-5p9xc"] Jul 08 18:21:23.930906 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.930884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-config\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:23.931064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.930915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-serving-cert\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:23.931064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.930940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-oauth-serving-cert\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:23.931064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.930959 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-trusted-ca-bundle\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:23.931064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.931039 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-service-ca\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:23.931223 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.931089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6tcc\" (UniqueName: \"kubernetes.io/projected/b7b729c8-1609-4076-b7c7-b0a169fa64d4-kube-api-access-m6tcc\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:23.931223 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:23.931128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-oauth-config\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.031878 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.031819 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-config\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.031878 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.031849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-serving-cert\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.031878 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.031870 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-oauth-serving-cert\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032088 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.031894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-trusted-ca-bundle\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032088 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.031913 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-service-ca\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.032182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6tcc\" (UniqueName: \"kubernetes.io/projected/b7b729c8-1609-4076-b7c7-b0a169fa64d4-kube-api-access-m6tcc\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032249 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.032237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-oauth-config\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032665 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.032638 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-config\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032802 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.032771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-service-ca\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032802 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.032758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-oauth-serving-cert\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.032802 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.032802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-trusted-ca-bundle\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.034492 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.034474 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-serving-cert\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.034694 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.034671 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-oauth-config\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.039963 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.039941 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6tcc\" (UniqueName: \"kubernetes.io/projected/b7b729c8-1609-4076-b7c7-b0a169fa64d4-kube-api-access-m6tcc\") pod \"console-7fd4fcdf68-5p9xc\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.081732 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.081703 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:24.211976 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.211946 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fd4fcdf68-5p9xc"] Jul 08 18:21:24.215120 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:21:24.215095 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b729c8_1609_4076_b7c7_b0a169fa64d4.slice/crio-3a954a7cfeda3eef1922228842f245717bff5de3d99ac5e1bbf7b1562f258b02 WatchSource:0}: Error finding container 3a954a7cfeda3eef1922228842f245717bff5de3d99ac5e1bbf7b1562f258b02: Status 404 returned error can't find the container with id 3a954a7cfeda3eef1922228842f245717bff5de3d99ac5e1bbf7b1562f258b02 Jul 08 18:21:24.987071 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.987034 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4fcdf68-5p9xc" event={"ID":"b7b729c8-1609-4076-b7c7-b0a169fa64d4","Type":"ContainerStarted","Data":"12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8"} Jul 08 18:21:24.987485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:24.987090 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4fcdf68-5p9xc" event={"ID":"b7b729c8-1609-4076-b7c7-b0a169fa64d4","Type":"ContainerStarted","Data":"3a954a7cfeda3eef1922228842f245717bff5de3d99ac5e1bbf7b1562f258b02"} Jul 08 18:21:25.005343 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:25.005293 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fd4fcdf68-5p9xc" podStartSLOduration=2.005259446 podStartE2EDuration="2.005259446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:21:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:21:25.002601175 +0000 UTC m=+297.744669769" watchObservedRunningTime="2026-07-08 18:21:25.005259446 +0000 UTC m=+297.747327997" Jul 08 18:21:27.616527 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:27.616495 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 18:21:34.082374 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:34.082333 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:34.085195 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:34.082394 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:34.087323 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:34.087301 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:35.035563 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:35.035536 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:21:35.079123 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:21:35.079087 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678d45df8b-qmq2g"] Jul 08 18:22:00.101695 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.101647 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-678d45df8b-qmq2g" podUID="aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" containerName="console" containerID="cri-o://fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3" gracePeriod=15 Jul 08 18:22:00.346064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.346042 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:22:00.398539 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.398521 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-oauth-config\") pod \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " Jul 08 18:22:00.398656 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.398549 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwlhn\" (UniqueName: \"kubernetes.io/projected/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-kube-api-access-kwlhn\") pod \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " Jul 08 18:22:00.398656 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.398613 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-config\") pod \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " Jul 08 18:22:00.398656 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.398632 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-trusted-ca-bundle\") pod \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " Jul 08 18:22:00.398797 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.398659 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-service-ca\") pod \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " Jul 08 18:22:00.398797 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.398688 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-oauth-serving-cert\") pod \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " Jul 08 18:22:00.398797 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.398731 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-serving-cert\") pod \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\" (UID: \"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030\") " Jul 08 18:22:00.399059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.399032 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-config" (OuterVolumeSpecName: "console-config") pod "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" (UID: "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:22:00.399175 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.399058 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" (UID: "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:22:00.399175 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.399083 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" (UID: "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:22:00.399321 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.399160 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" (UID: "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:22:00.400592 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.400567 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-kube-api-access-kwlhn" (OuterVolumeSpecName: "kube-api-access-kwlhn") pod "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" (UID: "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030"). InnerVolumeSpecName "kube-api-access-kwlhn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:22:00.400690 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.400649 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" (UID: "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:22:00.400883 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.400869 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" (UID: "aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:22:00.499379 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.499359 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:22:00.499379 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.499380 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-trusted-ca-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:22:00.499495 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.499389 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:22:00.499495 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.499397 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:22:00.499495 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.499405 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:22:00.499495 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.499413 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:22:00.499495 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:00.499422 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwlhn\" (UniqueName: \"kubernetes.io/projected/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030-kube-api-access-kwlhn\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:22:01.144373 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.144331 2558 generic.go:356] "Generic (PLEG): container finished" podID="aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" containerID="fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3" exitCode=0 Jul 08 18:22:01.144842 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.144394 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-678d45df8b-qmq2g" Jul 08 18:22:01.144842 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.144393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678d45df8b-qmq2g" event={"ID":"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030","Type":"ContainerDied","Data":"fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3"} Jul 08 18:22:01.144842 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.144528 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-678d45df8b-qmq2g" event={"ID":"aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030","Type":"ContainerDied","Data":"3ee451e533bf404f488617c6e2d1ee23fdac6d6ba838282f15b40cd72b219f5e"} Jul 08 18:22:01.144842 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.144552 2558 scope.go:117] "RemoveContainer" containerID="fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3" Jul 08 18:22:01.154778 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.154755 2558 scope.go:117] "RemoveContainer" containerID="fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3" Jul 08 18:22:01.155091 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:22:01.155073 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3\": container with ID starting with fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3 not found: ID does not exist" containerID="fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3" Jul 08 18:22:01.155152 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.155098 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3"} err="failed to get container status \"fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3\": rpc error: code = NotFound desc = could not find container \"fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3\": container with ID starting with fd72e36c50824caac57de1f334b228aa2627979f47892f49bae4987b7ce3c1d3 not found: ID does not exist" Jul 08 18:22:01.165353 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.165329 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-678d45df8b-qmq2g"] Jul 08 18:22:01.167387 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.167359 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-678d45df8b-qmq2g"] Jul 08 18:22:01.729521 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:01.729492 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" path="/var/lib/kubelet/pods/aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030/volumes" Jul 08 18:22:44.070496 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.070463 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7"] Jul 08 18:22:44.070956 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.070764 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" containerName="console" Jul 08 18:22:44.070956 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.070775 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" containerName="console" Jul 08 18:22:44.070956 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.070860 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5596e3-1c4f-4a4f-ad70-91f2ebfcd030" containerName="console" Jul 08 18:22:44.075060 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.075045 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.078114 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.078087 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x2wdj\"" Jul 08 18:22:44.079406 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.078758 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 18:22:44.079406 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.078828 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 18:22:44.083950 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.083920 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7"] Jul 08 18:22:44.217485 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.217454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.217621 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.217498 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5686l\" (UniqueName: \"kubernetes.io/projected/c6a65e6b-0780-4c76-ba78-755012aa9c79-kube-api-access-5686l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.217621 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.217520 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.318777 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.318751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.318913 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.318788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5686l\" (UniqueName: \"kubernetes.io/projected/c6a65e6b-0780-4c76-ba78-755012aa9c79-kube-api-access-5686l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.318913 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.318811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.319129 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.319112 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.319192 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.319148 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.327612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.327554 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5686l\" (UniqueName: \"kubernetes.io/projected/c6a65e6b-0780-4c76-ba78-755012aa9c79-kube-api-access-5686l\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.389860 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.389838 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:22:44.516841 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.516817 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7"] Jul 08 18:22:44.519360 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:22:44.519330 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6a65e6b_0780_4c76_ba78_755012aa9c79.slice/crio-2c2bc5cd45f5b0dd03ae5995fae80a22a5d6ca9beb9de2f292cfd929c6305bb6 WatchSource:0}: Error finding container 2c2bc5cd45f5b0dd03ae5995fae80a22a5d6ca9beb9de2f292cfd929c6305bb6: Status 404 returned error can't find the container with id 2c2bc5cd45f5b0dd03ae5995fae80a22a5d6ca9beb9de2f292cfd929c6305bb6 Jul 08 18:22:44.521217 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:44.521199 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:22:45.334109 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:45.334076 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" event={"ID":"c6a65e6b-0780-4c76-ba78-755012aa9c79","Type":"ContainerStarted","Data":"2c2bc5cd45f5b0dd03ae5995fae80a22a5d6ca9beb9de2f292cfd929c6305bb6"} Jul 08 18:22:56.388171 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:56.388134 2558 generic.go:356] "Generic (PLEG): container finished" podID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerID="e953b1eb3077a3194ac1bd1955a92466968dce36e868df75fdb710e2b2ec0028" exitCode=0 Jul 08 18:22:56.388652 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:56.388227 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" event={"ID":"c6a65e6b-0780-4c76-ba78-755012aa9c79","Type":"ContainerDied","Data":"e953b1eb3077a3194ac1bd1955a92466968dce36e868df75fdb710e2b2ec0028"} Jul 08 18:22:58.398590 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:58.398556 2558 generic.go:356] "Generic (PLEG): container finished" podID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerID="76ddd8bc89815114594ca68d15df28ee63cebeb2d946b5c6e45aa676bff4fcf6" exitCode=0 Jul 08 18:22:58.398961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:22:58.398643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" event={"ID":"c6a65e6b-0780-4c76-ba78-755012aa9c79","Type":"ContainerDied","Data":"76ddd8bc89815114594ca68d15df28ee63cebeb2d946b5c6e45aa676bff4fcf6"} Jul 08 18:23:06.436970 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:06.436940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" event={"ID":"c6a65e6b-0780-4c76-ba78-755012aa9c79","Type":"ContainerStarted","Data":"72d23759c59dae9dcc2208a6fecbf55af1e57d427ae4ca78e568d65c8106e413"} Jul 08 18:23:06.457612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:06.457565 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" podStartSLOduration=1.83701775 podStartE2EDuration="22.457550074s" totalImagesPullingTime="20.620532324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:22:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:06.454937596 +0000 UTC m=+399.197006174" watchObservedRunningTime="2026-07-08 18:23:06.457550074 +0000 UTC m=+399.199618625" Jul 08 18:23:07.443107 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:07.443075 2558 generic.go:356] "Generic (PLEG): container finished" podID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerID="72d23759c59dae9dcc2208a6fecbf55af1e57d427ae4ca78e568d65c8106e413" exitCode=0 Jul 08 18:23:07.443491 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:07.443157 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" event={"ID":"c6a65e6b-0780-4c76-ba78-755012aa9c79","Type":"ContainerDied","Data":"72d23759c59dae9dcc2208a6fecbf55af1e57d427ae4ca78e568d65c8106e413"} Jul 08 18:23:08.578024 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.578001 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:23:08.624652 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.624622 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5686l\" (UniqueName: \"kubernetes.io/projected/c6a65e6b-0780-4c76-ba78-755012aa9c79-kube-api-access-5686l\") pod \"c6a65e6b-0780-4c76-ba78-755012aa9c79\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " Jul 08 18:23:08.624777 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.624705 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-bundle\") pod \"c6a65e6b-0780-4c76-ba78-755012aa9c79\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " Jul 08 18:23:08.624842 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.624782 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-util\") pod \"c6a65e6b-0780-4c76-ba78-755012aa9c79\" (UID: \"c6a65e6b-0780-4c76-ba78-755012aa9c79\") " Jul 08 18:23:08.625310 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.625264 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-bundle" (OuterVolumeSpecName: "bundle") pod "c6a65e6b-0780-4c76-ba78-755012aa9c79" (UID: "c6a65e6b-0780-4c76-ba78-755012aa9c79"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:23:08.626747 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.626722 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6a65e6b-0780-4c76-ba78-755012aa9c79-kube-api-access-5686l" (OuterVolumeSpecName: "kube-api-access-5686l") pod "c6a65e6b-0780-4c76-ba78-755012aa9c79" (UID: "c6a65e6b-0780-4c76-ba78-755012aa9c79"). InnerVolumeSpecName "kube-api-access-5686l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:23:08.628703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.628683 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-util" (OuterVolumeSpecName: "util") pod "c6a65e6b-0780-4c76-ba78-755012aa9c79" (UID: "c6a65e6b-0780-4c76-ba78-755012aa9c79"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:23:08.726292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.726234 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-util\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:08.726292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.726255 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5686l\" (UniqueName: \"kubernetes.io/projected/c6a65e6b-0780-4c76-ba78-755012aa9c79-kube-api-access-5686l\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:08.726292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:08.726266 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c6a65e6b-0780-4c76-ba78-755012aa9c79-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:09.454871 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:09.454842 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" Jul 08 18:23:09.455032 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:09.454864 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zhsr7" event={"ID":"c6a65e6b-0780-4c76-ba78-755012aa9c79","Type":"ContainerDied","Data":"2c2bc5cd45f5b0dd03ae5995fae80a22a5d6ca9beb9de2f292cfd929c6305bb6"} Jul 08 18:23:09.455032 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:09.454923 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c2bc5cd45f5b0dd03ae5995fae80a22a5d6ca9beb9de2f292cfd929c6305bb6" Jul 08 18:23:17.081797 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.081757 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd"] Jul 08 18:23:17.082432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.082242 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerName="pull" Jul 08 18:23:17.082432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.082262 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerName="pull" Jul 08 18:23:17.082432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.082310 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerName="extract" Jul 08 18:23:17.082432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.082319 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerName="extract" Jul 08 18:23:17.082432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.082340 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerName="util" Jul 08 18:23:17.082432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.082349 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerName="util" Jul 08 18:23:17.082432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.082432 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6a65e6b-0780-4c76-ba78-755012aa9c79" containerName="extract" Jul 08 18:23:17.086563 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.086540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.089347 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.089319 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 18:23:17.089473 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.089353 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-dnbpw\"" Jul 08 18:23:17.089473 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.089409 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:23:17.103178 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.103153 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd"] Jul 08 18:23:17.188052 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.188026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79980448-efc1-406b-9124-f9cbff1e08f4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8fsnd\" (UID: \"79980448-efc1-406b-9124-f9cbff1e08f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.188166 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.188065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlfrd\" (UniqueName: \"kubernetes.io/projected/79980448-efc1-406b-9124-f9cbff1e08f4-kube-api-access-vlfrd\") pod \"cert-manager-operator-controller-manager-55c444bf86-8fsnd\" (UID: \"79980448-efc1-406b-9124-f9cbff1e08f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.288896 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.288870 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79980448-efc1-406b-9124-f9cbff1e08f4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8fsnd\" (UID: \"79980448-efc1-406b-9124-f9cbff1e08f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.288995 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.288906 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlfrd\" (UniqueName: \"kubernetes.io/projected/79980448-efc1-406b-9124-f9cbff1e08f4-kube-api-access-vlfrd\") pod \"cert-manager-operator-controller-manager-55c444bf86-8fsnd\" (UID: \"79980448-efc1-406b-9124-f9cbff1e08f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.289222 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.289205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79980448-efc1-406b-9124-f9cbff1e08f4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-8fsnd\" (UID: \"79980448-efc1-406b-9124-f9cbff1e08f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.296916 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.296893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlfrd\" (UniqueName: \"kubernetes.io/projected/79980448-efc1-406b-9124-f9cbff1e08f4-kube-api-access-vlfrd\") pod \"cert-manager-operator-controller-manager-55c444bf86-8fsnd\" (UID: \"79980448-efc1-406b-9124-f9cbff1e08f4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.396493 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.396472 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" Jul 08 18:23:17.531158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:17.531127 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd"] Jul 08 18:23:17.534215 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:23:17.534190 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79980448_efc1_406b_9124_f9cbff1e08f4.slice/crio-b45a1a7da9900472a7b5051af4cefe9d672aa1f849a157945ea194d3a7c58dd0 WatchSource:0}: Error finding container b45a1a7da9900472a7b5051af4cefe9d672aa1f849a157945ea194d3a7c58dd0: Status 404 returned error can't find the container with id b45a1a7da9900472a7b5051af4cefe9d672aa1f849a157945ea194d3a7c58dd0 Jul 08 18:23:18.494874 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:18.494838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" event={"ID":"79980448-efc1-406b-9124-f9cbff1e08f4","Type":"ContainerStarted","Data":"b45a1a7da9900472a7b5051af4cefe9d672aa1f849a157945ea194d3a7c58dd0"} Jul 08 18:23:19.501506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:19.501470 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" event={"ID":"79980448-efc1-406b-9124-f9cbff1e08f4","Type":"ContainerStarted","Data":"956089d995d60a9d2b161d4acae272ced82876c5190166ca602131ad74042b59"} Jul 08 18:23:19.520859 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:19.520664 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-8fsnd" podStartSLOduration=0.966339686 podStartE2EDuration="2.520643513s" totalImagesPullingTime="1.554303827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:19.519222074 +0000 UTC m=+412.261290649" watchObservedRunningTime="2026-07-08 18:23:19.520643513 +0000 UTC m=+412.262712064" Jul 08 18:23:20.878982 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.878955 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7"] Jul 08 18:23:20.881327 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.881306 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:20.884159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.884143 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x2wdj\"" Jul 08 18:23:20.884437 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.884423 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 18:23:20.885292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.885263 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 18:23:20.899318 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.899296 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7"] Jul 08 18:23:20.979026 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.979002 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hgtft"] Jul 08 18:23:20.981147 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.981134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:20.983659 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.983632 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 18:23:20.983742 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.983663 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 18:23:20.983742 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.983707 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2hjcp\"" Jul 08 18:23:20.991342 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:20.991318 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hgtft"] Jul 08 18:23:21.021949 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.021924 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.022040 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.021961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk4qh\" (UniqueName: \"kubernetes.io/projected/be25e051-6ef4-44e8-9973-9e9a084af639-kube-api-access-sk4qh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.022040 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.022002 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.122517 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.122494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.122595 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.122536 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk4qh\" (UniqueName: \"kubernetes.io/projected/be25e051-6ef4-44e8-9973-9e9a084af639-kube-api-access-sk4qh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.122595 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.122578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w246g\" (UniqueName: \"kubernetes.io/projected/45ee464a-5731-402f-84cd-f19e0a66dfeb-kube-api-access-w246g\") pod \"cert-manager-webhook-6486ffd997-hgtft\" (UID: \"45ee464a-5731-402f-84cd-f19e0a66dfeb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:21.122663 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.122601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45ee464a-5731-402f-84cd-f19e0a66dfeb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hgtft\" (UID: \"45ee464a-5731-402f-84cd-f19e0a66dfeb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:21.122663 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.122618 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.122836 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.122820 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.122929 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.122914 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.134502 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.134449 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk4qh\" (UniqueName: \"kubernetes.io/projected/be25e051-6ef4-44e8-9973-9e9a084af639-kube-api-access-sk4qh\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.190386 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.190364 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:21.223222 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.223196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w246g\" (UniqueName: \"kubernetes.io/projected/45ee464a-5731-402f-84cd-f19e0a66dfeb-kube-api-access-w246g\") pod \"cert-manager-webhook-6486ffd997-hgtft\" (UID: \"45ee464a-5731-402f-84cd-f19e0a66dfeb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:21.223342 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.223233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45ee464a-5731-402f-84cd-f19e0a66dfeb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hgtft\" (UID: \"45ee464a-5731-402f-84cd-f19e0a66dfeb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:21.232072 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.232046 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w246g\" (UniqueName: \"kubernetes.io/projected/45ee464a-5731-402f-84cd-f19e0a66dfeb-kube-api-access-w246g\") pod \"cert-manager-webhook-6486ffd997-hgtft\" (UID: \"45ee464a-5731-402f-84cd-f19e0a66dfeb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:21.232171 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.232153 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45ee464a-5731-402f-84cd-f19e0a66dfeb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hgtft\" (UID: \"45ee464a-5731-402f-84cd-f19e0a66dfeb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:21.296757 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.296733 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:21.318537 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.318511 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7"] Jul 08 18:23:21.320346 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:23:21.320306 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe25e051_6ef4_44e8_9973_9e9a084af639.slice/crio-82d64a838062678c3e2109dd268a543a3f394bccb14b9c110f55a5b3d1b5f320 WatchSource:0}: Error finding container 82d64a838062678c3e2109dd268a543a3f394bccb14b9c110f55a5b3d1b5f320: Status 404 returned error can't find the container with id 82d64a838062678c3e2109dd268a543a3f394bccb14b9c110f55a5b3d1b5f320 Jul 08 18:23:21.433647 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.433621 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hgtft"] Jul 08 18:23:21.479084 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:23:21.479052 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45ee464a_5731_402f_84cd_f19e0a66dfeb.slice/crio-c55957d4a065a80551d9eedd1498973bf31725fe722ffd66bd9aca6e74809be9 WatchSource:0}: Error finding container c55957d4a065a80551d9eedd1498973bf31725fe722ffd66bd9aca6e74809be9: Status 404 returned error can't find the container with id c55957d4a065a80551d9eedd1498973bf31725fe722ffd66bd9aca6e74809be9 Jul 08 18:23:21.511325 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.511302 2558 generic.go:356] "Generic (PLEG): container finished" podID="be25e051-6ef4-44e8-9973-9e9a084af639" containerID="122413a7beee5815fc7720b29e6b9132568a0951f04d8fe75b9fc6f0f7473d53" exitCode=0 Jul 08 18:23:21.511431 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.511417 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" event={"ID":"be25e051-6ef4-44e8-9973-9e9a084af639","Type":"ContainerDied","Data":"122413a7beee5815fc7720b29e6b9132568a0951f04d8fe75b9fc6f0f7473d53"} Jul 08 18:23:21.511499 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.511458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" event={"ID":"be25e051-6ef4-44e8-9973-9e9a084af639","Type":"ContainerStarted","Data":"82d64a838062678c3e2109dd268a543a3f394bccb14b9c110f55a5b3d1b5f320"} Jul 08 18:23:21.512618 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:21.512590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" event={"ID":"45ee464a-5731-402f-84cd-f19e0a66dfeb","Type":"ContainerStarted","Data":"c55957d4a065a80551d9eedd1498973bf31725fe722ffd66bd9aca6e74809be9"} Jul 08 18:23:25.534961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:25.534905 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" event={"ID":"45ee464a-5731-402f-84cd-f19e0a66dfeb","Type":"ContainerStarted","Data":"3972581c3883a72d70ddd320e958bf77ad749cbbe6f61e2eaa075e04ba21d4c5"} Jul 08 18:23:25.535438 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:25.534974 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:25.536605 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:25.536581 2558 generic.go:356] "Generic (PLEG): container finished" podID="be25e051-6ef4-44e8-9973-9e9a084af639" containerID="7c69fa91610ca8e8824e2b544732f675676229ae414bd94ddf06ce0510c95f7e" exitCode=0 Jul 08 18:23:25.536721 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:25.536662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" event={"ID":"be25e051-6ef4-44e8-9973-9e9a084af639","Type":"ContainerDied","Data":"7c69fa91610ca8e8824e2b544732f675676229ae414bd94ddf06ce0510c95f7e"} Jul 08 18:23:25.551921 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:25.551882 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" podStartSLOduration=2.280949962 podStartE2EDuration="5.551869735s" totalImagesPullingTime="3.270919773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:25.550912947 +0000 UTC m=+418.292981499" watchObservedRunningTime="2026-07-08 18:23:25.551869735 +0000 UTC m=+418.293938289" Jul 08 18:23:26.543954 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:26.543922 2558 generic.go:356] "Generic (PLEG): container finished" podID="be25e051-6ef4-44e8-9973-9e9a084af639" containerID="f70c91ee7cf557deed56af7e79caaa063fbcb8af36b279a3c8e95639f42490b7" exitCode=0 Jul 08 18:23:26.544386 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:26.544010 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" event={"ID":"be25e051-6ef4-44e8-9973-9e9a084af639","Type":"ContainerDied","Data":"f70c91ee7cf557deed56af7e79caaa063fbcb8af36b279a3c8e95639f42490b7"} Jul 08 18:23:27.680046 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.680018 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:27.779702 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.779678 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-util\") pod \"be25e051-6ef4-44e8-9973-9e9a084af639\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " Jul 08 18:23:27.779867 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.779787 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-bundle\") pod \"be25e051-6ef4-44e8-9973-9e9a084af639\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " Jul 08 18:23:27.779867 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.779816 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk4qh\" (UniqueName: \"kubernetes.io/projected/be25e051-6ef4-44e8-9973-9e9a084af639-kube-api-access-sk4qh\") pod \"be25e051-6ef4-44e8-9973-9e9a084af639\" (UID: \"be25e051-6ef4-44e8-9973-9e9a084af639\") " Jul 08 18:23:27.780153 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.780114 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-bundle" (OuterVolumeSpecName: "bundle") pod "be25e051-6ef4-44e8-9973-9e9a084af639" (UID: "be25e051-6ef4-44e8-9973-9e9a084af639"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:23:27.781827 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.781806 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be25e051-6ef4-44e8-9973-9e9a084af639-kube-api-access-sk4qh" (OuterVolumeSpecName: "kube-api-access-sk4qh") pod "be25e051-6ef4-44e8-9973-9e9a084af639" (UID: "be25e051-6ef4-44e8-9973-9e9a084af639"). InnerVolumeSpecName "kube-api-access-sk4qh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:23:27.784025 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.784006 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-util" (OuterVolumeSpecName: "util") pod "be25e051-6ef4-44e8-9973-9e9a084af639" (UID: "be25e051-6ef4-44e8-9973-9e9a084af639"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:23:27.881819 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.881437 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-util\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:27.881819 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.881469 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be25e051-6ef4-44e8-9973-9e9a084af639-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:27.881819 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:27.881483 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk4qh\" (UniqueName: \"kubernetes.io/projected/be25e051-6ef4-44e8-9973-9e9a084af639-kube-api-access-sk4qh\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:28.556810 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:28.556781 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" Jul 08 18:23:28.557003 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:28.556772 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fk9rp7" event={"ID":"be25e051-6ef4-44e8-9973-9e9a084af639","Type":"ContainerDied","Data":"82d64a838062678c3e2109dd268a543a3f394bccb14b9c110f55a5b3d1b5f320"} Jul 08 18:23:28.557003 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:28.556915 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82d64a838062678c3e2109dd268a543a3f394bccb14b9c110f55a5b3d1b5f320" Jul 08 18:23:31.546725 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:31.546693 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hgtft" Jul 08 18:23:40.647222 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647187 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m"] Jul 08 18:23:40.647703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647531 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be25e051-6ef4-44e8-9973-9e9a084af639" containerName="extract" Jul 08 18:23:40.647703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647543 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="be25e051-6ef4-44e8-9973-9e9a084af639" containerName="extract" Jul 08 18:23:40.647703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647552 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be25e051-6ef4-44e8-9973-9e9a084af639" containerName="util" Jul 08 18:23:40.647703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647558 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="be25e051-6ef4-44e8-9973-9e9a084af639" containerName="util" Jul 08 18:23:40.647703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647574 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be25e051-6ef4-44e8-9973-9e9a084af639" containerName="pull" Jul 08 18:23:40.647703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647580 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="be25e051-6ef4-44e8-9973-9e9a084af639" containerName="pull" Jul 08 18:23:40.647703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.647641 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="be25e051-6ef4-44e8-9973-9e9a084af639" containerName="extract" Jul 08 18:23:40.650454 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.650438 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.653008 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.652986 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 18:23:40.653933 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.653908 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 18:23:40.654029 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.653910 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x2wdj\"" Jul 08 18:23:40.658818 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.658793 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m"] Jul 08 18:23:40.787731 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.787693 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztr25\" (UniqueName: \"kubernetes.io/projected/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-kube-api-access-ztr25\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.787914 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.787740 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.787914 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.787759 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.888543 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.888502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztr25\" (UniqueName: \"kubernetes.io/projected/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-kube-api-access-ztr25\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.888745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.888556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.888745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.888587 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.888938 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.888921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.889025 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.889004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.896523 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.896493 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztr25\" (UniqueName: \"kubernetes.io/projected/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-kube-api-access-ztr25\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:40.960067 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:40.959978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:41.089453 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:41.089363 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m"] Jul 08 18:23:41.091751 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:23:41.091716 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9457c4a_899d_4e04_b5ff_5dc0a61621a9.slice/crio-f826a83da2811b08f873dba680c54edcd04462b4343afdfc79e6983e1a73fe06 WatchSource:0}: Error finding container f826a83da2811b08f873dba680c54edcd04462b4343afdfc79e6983e1a73fe06: Status 404 returned error can't find the container with id f826a83da2811b08f873dba680c54edcd04462b4343afdfc79e6983e1a73fe06 Jul 08 18:23:41.616619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:41.616584 2558 generic.go:356] "Generic (PLEG): container finished" podID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerID="daf628b559a5efe2d94f721338b021782b07968d0c941655bbd7df0265aea7e1" exitCode=0 Jul 08 18:23:41.616829 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:41.616669 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" event={"ID":"d9457c4a-899d-4e04-b5ff-5dc0a61621a9","Type":"ContainerDied","Data":"daf628b559a5efe2d94f721338b021782b07968d0c941655bbd7df0265aea7e1"} Jul 08 18:23:41.616829 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:41.616716 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" event={"ID":"d9457c4a-899d-4e04-b5ff-5dc0a61621a9","Type":"ContainerStarted","Data":"f826a83da2811b08f873dba680c54edcd04462b4343afdfc79e6983e1a73fe06"} Jul 08 18:23:42.630953 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:42.630922 2558 generic.go:356] "Generic (PLEG): container finished" podID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerID="9da55bb1448dfbdc72936b6a01f2fd1a63ba6c3fcac6c8136f983e86b8ca4067" exitCode=0 Jul 08 18:23:42.631340 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:42.630999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" event={"ID":"d9457c4a-899d-4e04-b5ff-5dc0a61621a9","Type":"ContainerDied","Data":"9da55bb1448dfbdc72936b6a01f2fd1a63ba6c3fcac6c8136f983e86b8ca4067"} Jul 08 18:23:43.637852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:43.637819 2558 generic.go:356] "Generic (PLEG): container finished" podID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerID="eddd23e3efbf6a2a3532ccc7fb95bf870d9e7872dc622966cc4523ea3b0487f7" exitCode=0 Jul 08 18:23:43.638265 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:43.637886 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" event={"ID":"d9457c4a-899d-4e04-b5ff-5dc0a61621a9","Type":"ContainerDied","Data":"eddd23e3efbf6a2a3532ccc7fb95bf870d9e7872dc622966cc4523ea3b0487f7"} Jul 08 18:23:44.766559 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:44.766535 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:44.923342 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:44.923226 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-bundle\") pod \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " Jul 08 18:23:44.923342 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:44.923306 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-util\") pod \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " Jul 08 18:23:44.923575 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:44.923370 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztr25\" (UniqueName: \"kubernetes.io/projected/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-kube-api-access-ztr25\") pod \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\" (UID: \"d9457c4a-899d-4e04-b5ff-5dc0a61621a9\") " Jul 08 18:23:44.923894 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:44.923861 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-bundle" (OuterVolumeSpecName: "bundle") pod "d9457c4a-899d-4e04-b5ff-5dc0a61621a9" (UID: "d9457c4a-899d-4e04-b5ff-5dc0a61621a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:23:44.925337 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:44.925315 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-kube-api-access-ztr25" (OuterVolumeSpecName: "kube-api-access-ztr25") pod "d9457c4a-899d-4e04-b5ff-5dc0a61621a9" (UID: "d9457c4a-899d-4e04-b5ff-5dc0a61621a9"). InnerVolumeSpecName "kube-api-access-ztr25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:23:44.929202 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:44.929176 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-util" (OuterVolumeSpecName: "util") pod "d9457c4a-899d-4e04-b5ff-5dc0a61621a9" (UID: "d9457c4a-899d-4e04-b5ff-5dc0a61621a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:23:45.024896 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:45.024864 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-util\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:45.024896 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:45.024893 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztr25\" (UniqueName: \"kubernetes.io/projected/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-kube-api-access-ztr25\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:45.024896 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:45.024904 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9457c4a-899d-4e04-b5ff-5dc0a61621a9-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:23:45.649539 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:45.649510 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" Jul 08 18:23:45.649715 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:45.649540 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afl867m" event={"ID":"d9457c4a-899d-4e04-b5ff-5dc0a61621a9","Type":"ContainerDied","Data":"f826a83da2811b08f873dba680c54edcd04462b4343afdfc79e6983e1a73fe06"} Jul 08 18:23:45.649715 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:45.649596 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f826a83da2811b08f873dba680c54edcd04462b4343afdfc79e6983e1a73fe06" Jul 08 18:23:55.060122 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060050 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp"] Jul 08 18:23:55.060509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060391 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerName="pull" Jul 08 18:23:55.060509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060403 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerName="pull" Jul 08 18:23:55.060509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060411 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerName="extract" Jul 08 18:23:55.060509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060417 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerName="extract" Jul 08 18:23:55.060509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060437 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerName="util" Jul 08 18:23:55.060509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060443 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerName="util" Jul 08 18:23:55.060509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.060494 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9457c4a-899d-4e04-b5ff-5dc0a61621a9" containerName="extract" Jul 08 18:23:55.064200 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.064183 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.068006 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.067985 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:23:55.068100 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.067992 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 18:23:55.068158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.068135 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-sz25f\"" Jul 08 18:23:55.068158 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.068135 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 18:23:55.068257 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.068188 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 18:23:55.068340 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.068286 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 18:23:55.074092 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.074071 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp"] Jul 08 18:23:55.101557 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.101535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b625172-2743-4c71-98a0-d145c8c198ba-cert\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.101661 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.101575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b625172-2743-4c71-98a0-d145c8c198ba-metrics-cert\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.101661 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.101641 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vtp9\" (UniqueName: \"kubernetes.io/projected/0b625172-2743-4c71-98a0-d145c8c198ba-kube-api-access-5vtp9\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.101740 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.101674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b625172-2743-4c71-98a0-d145c8c198ba-manager-config\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.202591 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.202562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b625172-2743-4c71-98a0-d145c8c198ba-cert\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.202716 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.202598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b625172-2743-4c71-98a0-d145c8c198ba-metrics-cert\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.202716 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.202623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vtp9\" (UniqueName: \"kubernetes.io/projected/0b625172-2743-4c71-98a0-d145c8c198ba-kube-api-access-5vtp9\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.202716 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.202640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b625172-2743-4c71-98a0-d145c8c198ba-manager-config\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.203222 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.203204 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0b625172-2743-4c71-98a0-d145c8c198ba-manager-config\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.205099 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.205079 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b625172-2743-4c71-98a0-d145c8c198ba-metrics-cert\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.205181 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.205166 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0b625172-2743-4c71-98a0-d145c8c198ba-cert\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.223548 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.223525 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vtp9\" (UniqueName: \"kubernetes.io/projected/0b625172-2743-4c71-98a0-d145c8c198ba-kube-api-access-5vtp9\") pod \"lws-controller-manager-85f5474f9b-qbjgp\" (UID: \"0b625172-2743-4c71-98a0-d145c8c198ba\") " pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.374972 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.374952 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:55.514748 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.514725 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp"] Jul 08 18:23:55.517361 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:23:55.517329 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b625172_2743_4c71_98a0_d145c8c198ba.slice/crio-789a79ef33f3d79d8c4c4dfc4c4837bc75320aeca5280d5cb6882becea286728 WatchSource:0}: Error finding container 789a79ef33f3d79d8c4c4dfc4c4837bc75320aeca5280d5cb6882becea286728: Status 404 returned error can't find the container with id 789a79ef33f3d79d8c4c4dfc4c4837bc75320aeca5280d5cb6882becea286728 Jul 08 18:23:55.694924 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.694845 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n"] Jul 08 18:23:55.699064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.699040 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" event={"ID":"0b625172-2743-4c71-98a0-d145c8c198ba","Type":"ContainerStarted","Data":"789a79ef33f3d79d8c4c4dfc4c4837bc75320aeca5280d5cb6882becea286728"} Jul 08 18:23:55.699183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.699129 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.702243 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.702216 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 18:23:55.702361 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.702332 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vlpxl\"" Jul 08 18:23:55.702514 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.702493 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 18:23:55.702617 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.702565 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 18:23:55.702975 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.702961 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 18:23:55.705163 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.705145 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c016b450-7012-43c8-8b2d-31601f6d4767-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.705244 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.705181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c016b450-7012-43c8-8b2d-31601f6d4767-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.705313 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.705249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8vdv\" (UniqueName: \"kubernetes.io/projected/c016b450-7012-43c8-8b2d-31601f6d4767-kube-api-access-b8vdv\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.705360 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.705347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c016b450-7012-43c8-8b2d-31601f6d4767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.705425 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.705410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c016b450-7012-43c8-8b2d-31601f6d4767-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.715543 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.715520 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n"] Jul 08 18:23:55.805781 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.805755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c016b450-7012-43c8-8b2d-31601f6d4767-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.805939 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.805787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8vdv\" (UniqueName: \"kubernetes.io/projected/c016b450-7012-43c8-8b2d-31601f6d4767-kube-api-access-b8vdv\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.805939 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.805816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c016b450-7012-43c8-8b2d-31601f6d4767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.805939 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.805892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c016b450-7012-43c8-8b2d-31601f6d4767-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.806103 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.805947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c016b450-7012-43c8-8b2d-31601f6d4767-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.806261 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.806242 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c016b450-7012-43c8-8b2d-31601f6d4767-manifests\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.808046 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.808024 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c016b450-7012-43c8-8b2d-31601f6d4767-tmp\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.808175 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.808157 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c016b450-7012-43c8-8b2d-31601f6d4767-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.808341 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.808322 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c016b450-7012-43c8-8b2d-31601f6d4767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:55.821212 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:55.821193 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8vdv\" (UniqueName: \"kubernetes.io/projected/c016b450-7012-43c8-8b2d-31601f6d4767-kube-api-access-b8vdv\") pod \"opendatahub-operator-controller-manager-79b9f59cf8-l226n\" (UID: \"c016b450-7012-43c8-8b2d-31601f6d4767\") " pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:56.009562 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:56.009462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:23:56.159560 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:56.159451 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n"] Jul 08 18:23:56.162409 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:23:56.162380 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc016b450_7012_43c8_8b2d_31601f6d4767.slice/crio-743c44a924c7a9f7920b7f6a1411c22a79e4b4b592a66491c1bd3746f6d8fa19 WatchSource:0}: Error finding container 743c44a924c7a9f7920b7f6a1411c22a79e4b4b592a66491c1bd3746f6d8fa19: Status 404 returned error can't find the container with id 743c44a924c7a9f7920b7f6a1411c22a79e4b4b592a66491c1bd3746f6d8fa19 Jul 08 18:23:56.703685 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:56.703644 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" event={"ID":"c016b450-7012-43c8-8b2d-31601f6d4767","Type":"ContainerStarted","Data":"743c44a924c7a9f7920b7f6a1411c22a79e4b4b592a66491c1bd3746f6d8fa19"} Jul 08 18:23:57.713056 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:57.713008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" event={"ID":"0b625172-2743-4c71-98a0-d145c8c198ba","Type":"ContainerStarted","Data":"65b7087ecae6ea971224ae0deb4c3e73f5054c7422c4ad00d5fe4cb53ce4c61b"} Jul 08 18:23:57.713529 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:57.713239 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:23:57.732116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:23:57.732061 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" podStartSLOduration=1.280651666 podStartE2EDuration="2.732041733s" totalImagesPullingTime="1.451390067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:23:57.731413696 +0000 UTC m=+450.473482248" watchObservedRunningTime="2026-07-08 18:23:57.732041733 +0000 UTC m=+450.474110284" Jul 08 18:24:00.731008 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:00.730979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" event={"ID":"c016b450-7012-43c8-8b2d-31601f6d4767","Type":"ContainerStarted","Data":"02bbaaaf68781390746b9c6549e84b672613c8a54769fe164e3c90db6661babe"} Jul 08 18:24:01.738035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:01.737996 2558 generic.go:356] "Generic (PLEG): container finished" podID="c016b450-7012-43c8-8b2d-31601f6d4767" containerID="02bbaaaf68781390746b9c6549e84b672613c8a54769fe164e3c90db6661babe" exitCode=0 Jul 08 18:24:01.738528 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:01.738078 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" event={"ID":"c016b450-7012-43c8-8b2d-31601f6d4767","Type":"ContainerDied","Data":"02bbaaaf68781390746b9c6549e84b672613c8a54769fe164e3c90db6661babe"} Jul 08 18:24:02.745003 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:02.744972 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" event={"ID":"c016b450-7012-43c8-8b2d-31601f6d4767","Type":"ContainerStarted","Data":"ccb91c7e9f3738d6d2473efbb7268892ad4fd0de01ce804d5510e3fdfba27a4e"} Jul 08 18:24:02.745449 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:02.745117 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:24:02.770287 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:02.770206 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" podStartSLOduration=2.573191807 podStartE2EDuration="7.7701862s" totalImagesPullingTime="4.149279959s" totalInitContainerRuntime="1.047714434s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:23:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:02.764959051 +0000 UTC m=+455.507027602" watchObservedRunningTime="2026-07-08 18:24:02.7701862 +0000 UTC m=+455.512254752" Jul 08 18:24:08.720927 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:08.720895 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85f5474f9b-qbjgp" Jul 08 18:24:13.751915 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:13.751884 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79b9f59cf8-l226n" Jul 08 18:24:38.027949 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.027918 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7"] Jul 08 18:24:38.035402 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.035384 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.037933 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.037912 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 18:24:38.038019 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.038009 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nkjk4\"" Jul 08 18:24:38.044863 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.044826 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7"] Jul 08 18:24:38.143077 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143175 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143175 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143123 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143260 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143260 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143227 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143360 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9fa1eb-e424-4358-abc1-902acaa3412d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143360 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143314 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtf2t\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-kube-api-access-xtf2t\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143360 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.143466 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.143382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.236285 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.236248 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9"] Jul 08 18:24:38.238628 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.238612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.244151 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244124 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9fa1eb-e424-4358-abc1-902acaa3412d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244295 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtf2t\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-kube-api-access-xtf2t\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244295 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244295 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244472 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244472 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244472 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244472 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244472 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244851 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.244851 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.244815 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.245108 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.245036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9fa1eb-e424-4358-abc1-902acaa3412d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.245108 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.245063 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.245415 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.245392 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.247344 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.247317 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.247721 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.247694 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.257063 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.257042 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9"] Jul 08 18:24:38.264770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.264750 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.273509 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.273484 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtf2t\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-kube-api-access-xtf2t\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.345023 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.344965 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345023 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345184 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345184 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345100 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7461ebed-7877-4f16-81e7-3ff9bb26a376-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345184 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345184 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgknb\" (UniqueName: \"kubernetes.io/projected/7461ebed-7877-4f16-81e7-3ff9bb26a376-kube-api-access-vgknb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345366 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345195 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345366 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.345366 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.345230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.346971 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.346958 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446657 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446736 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7461ebed-7877-4f16-81e7-3ff9bb26a376-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446909 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgknb\" (UniqueName: \"kubernetes.io/projected/7461ebed-7877-4f16-81e7-3ff9bb26a376-kube-api-access-vgknb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.446978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.447010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447780 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.447506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447822 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.447792 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.447822 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.447806 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.448238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.448211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.448456 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.448432 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7461ebed-7877-4f16-81e7-3ff9bb26a376-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.450474 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.450455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.450727 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.450706 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.459960 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.459935 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7461ebed-7877-4f16-81e7-3ff9bb26a376-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.460233 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.460216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgknb\" (UniqueName: \"kubernetes.io/projected/7461ebed-7877-4f16-81e7-3ff9bb26a376-kube-api-access-vgknb\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4f9kv9\" (UID: \"7461ebed-7877-4f16-81e7-3ff9bb26a376\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.481889 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.481864 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7"] Jul 08 18:24:38.482980 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:24:38.482954 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9fa1eb_e424_4358_abc1_902acaa3412d.slice/crio-6601be9645b4d8ed7f4daf4a2915e4c215e0b159d7faee32072a3b6a374ab436 WatchSource:0}: Error finding container 6601be9645b4d8ed7f4daf4a2915e4c215e0b159d7faee32072a3b6a374ab436: Status 404 returned error can't find the container with id 6601be9645b4d8ed7f4daf4a2915e4c215e0b159d7faee32072a3b6a374ab436 Jul 08 18:24:38.549990 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.549956 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:38.683070 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.683034 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9"] Jul 08 18:24:38.689148 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:24:38.689123 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7461ebed_7877_4f16_81e7_3ff9bb26a376.slice/crio-de910f06de40ba52b2a3a8b02cac72f5ab43fd8241f36c1f5422a95ae0c937b6 WatchSource:0}: Error finding container de910f06de40ba52b2a3a8b02cac72f5ab43fd8241f36c1f5422a95ae0c937b6: Status 404 returned error can't find the container with id de910f06de40ba52b2a3a8b02cac72f5ab43fd8241f36c1f5422a95ae0c937b6 Jul 08 18:24:38.918588 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.918553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" event={"ID":"7461ebed-7877-4f16-81e7-3ff9bb26a376","Type":"ContainerStarted","Data":"de910f06de40ba52b2a3a8b02cac72f5ab43fd8241f36c1f5422a95ae0c937b6"} Jul 08 18:24:38.920262 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:38.920235 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" event={"ID":"ec9fa1eb-e424-4358-abc1-902acaa3412d","Type":"ContainerStarted","Data":"6601be9645b4d8ed7f4daf4a2915e4c215e0b159d7faee32072a3b6a374ab436"} Jul 08 18:24:41.155445 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.155400 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:24:41.155772 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.155472 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:24:41.155772 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.155501 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:24:41.162259 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.162227 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:24:41.162362 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.162344 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:24:41.162405 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.162390 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 08 18:24:41.937535 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.937495 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" event={"ID":"ec9fa1eb-e424-4358-abc1-902acaa3412d","Type":"ContainerStarted","Data":"464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604"} Jul 08 18:24:41.938794 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.938772 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" event={"ID":"7461ebed-7877-4f16-81e7-3ff9bb26a376","Type":"ContainerStarted","Data":"09c7c60eb7655f6a99c2cc4ea88bb20aee469b2faef0d8b32560b057d4998a9b"} Jul 08 18:24:41.971923 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.971861 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" podStartSLOduration=1.301578293 podStartE2EDuration="3.971847962s" totalImagesPullingTime="2.670269669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:41.970012357 +0000 UTC m=+494.712080928" watchObservedRunningTime="2026-07-08 18:24:41.971847962 +0000 UTC m=+494.713916513" Jul 08 18:24:41.999160 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:41.999119 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" podStartSLOduration=1.528365443 podStartE2EDuration="3.999106683s" totalImagesPullingTime="2.47074124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:24:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:24:41.997602769 +0000 UTC m=+494.739671321" watchObservedRunningTime="2026-07-08 18:24:41.999106683 +0000 UTC m=+494.741175233" Jul 08 18:24:42.347774 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.347704 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:42.348909 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.348874 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 08 18:24:42.348993 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.348936 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 08 18:24:42.550715 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.550684 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:42.555723 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.555701 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:42.944476 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.944443 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:42.945515 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.945493 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4f9kv9" Jul 08 18:24:42.993788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:42.993760 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7"] Jul 08 18:24:43.347600 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:43.347528 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 08 18:24:43.347600 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:43.347581 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 08 18:24:44.347384 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:44.347341 2558 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 08 18:24:44.347808 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:44.347418 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 08 18:24:44.955447 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:44.955385 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerName="istio-proxy" containerID="cri-o://464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604" gracePeriod=30 Jul 08 18:24:50.197877 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.197855 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:50.349168 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349106 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-token\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349168 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349160 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-data\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349184 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-certs\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349209 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-credential-socket\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349226 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9fa1eb-e424-4358-abc1-902acaa3412d-istiod-ca-cert\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349261 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtf2t\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-kube-api-access-xtf2t\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349316 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-podinfo\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349360 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-socket\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349711 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349421 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:24:50.349711 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349432 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-envoy\") pod \"ec9fa1eb-e424-4358-abc1-902acaa3412d\" (UID: \"ec9fa1eb-e424-4358-abc1-902acaa3412d\") " Jul 08 18:24:50.349711 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349629 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:24:50.349711 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349643 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:24:50.349909 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349744 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec9fa1eb-e424-4358-abc1-902acaa3412d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:24:50.349909 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349812 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:24:50.349909 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349898 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-data\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.350059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349912 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-certs\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.350059 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.349921 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-credential-socket\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.351587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.351561 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:24:50.351705 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.351689 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:24:50.351844 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.351815 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:24:50.351903 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.351828 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-kube-api-access-xtf2t" (OuterVolumeSpecName: "kube-api-access-xtf2t") pod "ec9fa1eb-e424-4358-abc1-902acaa3412d" (UID: "ec9fa1eb-e424-4358-abc1-902acaa3412d"). InnerVolumeSpecName "kube-api-access-xtf2t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:24:50.450857 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.450836 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ec9fa1eb-e424-4358-abc1-902acaa3412d-istiod-ca-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.450857 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.450855 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtf2t\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-kube-api-access-xtf2t\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.450973 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.450866 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-podinfo\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.450973 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.450874 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-workload-socket\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.450973 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.450883 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-envoy\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.450973 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.450896 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec9fa1eb-e424-4358-abc1-902acaa3412d-istio-token\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:24:50.986733 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.986700 2558 generic.go:356] "Generic (PLEG): container finished" podID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerID="464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604" exitCode=0 Jul 08 18:24:50.986906 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.986764 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" Jul 08 18:24:50.986906 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.986791 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" event={"ID":"ec9fa1eb-e424-4358-abc1-902acaa3412d","Type":"ContainerDied","Data":"464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604"} Jul 08 18:24:50.986906 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.986869 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7" event={"ID":"ec9fa1eb-e424-4358-abc1-902acaa3412d","Type":"ContainerDied","Data":"6601be9645b4d8ed7f4daf4a2915e4c215e0b159d7faee32072a3b6a374ab436"} Jul 08 18:24:50.986906 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.986893 2558 scope.go:117] "RemoveContainer" containerID="464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604" Jul 08 18:24:50.996187 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.996165 2558 scope.go:117] "RemoveContainer" containerID="464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604" Jul 08 18:24:50.996466 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:24:50.996422 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604\": container with ID starting with 464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604 not found: ID does not exist" containerID="464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604" Jul 08 18:24:50.996530 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:50.996477 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604"} err="failed to get container status \"464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604\": rpc error: code = NotFound desc = could not find container \"464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604\": container with ID starting with 464046847bf9d8846278c2622df84baadcc90401df331c6576842a9c5f5e0604 not found: ID does not exist" Jul 08 18:24:51.008892 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:51.008872 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7"] Jul 08 18:24:51.013303 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:51.013264 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-xfmz7"] Jul 08 18:24:51.729073 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:24:51.729040 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" path="/var/lib/kubelet/pods/ec9fa1eb-e424-4358-abc1-902acaa3412d/volumes" Jul 08 18:25:16.844392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.844360 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ww6pp"] Jul 08 18:25:16.844833 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.844707 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerName="istio-proxy" Jul 08 18:25:16.844833 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.844719 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerName="istio-proxy" Jul 08 18:25:16.844833 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.844788 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec9fa1eb-e424-4358-abc1-902acaa3412d" containerName="istio-proxy" Jul 08 18:25:16.855132 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.855103 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" Jul 08 18:25:16.857075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.857053 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ww6pp"] Jul 08 18:25:16.857837 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.857811 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5t2sw\"" Jul 08 18:25:16.857947 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.857923 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 18:25:16.858872 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.858852 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 18:25:16.963284 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:16.963243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qswfv\" (UniqueName: \"kubernetes.io/projected/eb37ef8c-507b-4995-b58d-10d35a9ad104-kube-api-access-qswfv\") pod \"kuadrant-operator-catalog-ww6pp\" (UID: \"eb37ef8c-507b-4995-b58d-10d35a9ad104\") " pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" Jul 08 18:25:17.064595 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.064569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qswfv\" (UniqueName: \"kubernetes.io/projected/eb37ef8c-507b-4995-b58d-10d35a9ad104-kube-api-access-qswfv\") pod \"kuadrant-operator-catalog-ww6pp\" (UID: \"eb37ef8c-507b-4995-b58d-10d35a9ad104\") " pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" Jul 08 18:25:17.073127 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.073096 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qswfv\" (UniqueName: \"kubernetes.io/projected/eb37ef8c-507b-4995-b58d-10d35a9ad104-kube-api-access-qswfv\") pod \"kuadrant-operator-catalog-ww6pp\" (UID: \"eb37ef8c-507b-4995-b58d-10d35a9ad104\") " pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" Jul 08 18:25:17.166220 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.166201 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" Jul 08 18:25:17.292669 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.292607 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ww6pp"] Jul 08 18:25:17.294974 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:17.294945 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb37ef8c_507b_4995_b58d_10d35a9ad104.slice/crio-7f2cf6f1fd5e96998075119417728a2cfeb84af75da2d351c23a5485be5b3b67 WatchSource:0}: Error finding container 7f2cf6f1fd5e96998075119417728a2cfeb84af75da2d351c23a5485be5b3b67: Status 404 returned error can't find the container with id 7f2cf6f1fd5e96998075119417728a2cfeb84af75da2d351c23a5485be5b3b67 Jul 08 18:25:17.350373 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.350345 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ww6pp"] Jul 08 18:25:17.419397 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.419346 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-976v7"] Jul 08 18:25:17.423968 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.423952 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:17.434051 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.434031 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-976v7"] Jul 08 18:25:17.569070 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.569041 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdgvp\" (UniqueName: \"kubernetes.io/projected/e713cbac-ccdc-4e33-9e52-1188d0162fc1-kube-api-access-hdgvp\") pod \"kuadrant-operator-catalog-976v7\" (UID: \"e713cbac-ccdc-4e33-9e52-1188d0162fc1\") " pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:17.669787 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.669730 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdgvp\" (UniqueName: \"kubernetes.io/projected/e713cbac-ccdc-4e33-9e52-1188d0162fc1-kube-api-access-hdgvp\") pod \"kuadrant-operator-catalog-976v7\" (UID: \"e713cbac-ccdc-4e33-9e52-1188d0162fc1\") " pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:17.677964 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.677940 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdgvp\" (UniqueName: \"kubernetes.io/projected/e713cbac-ccdc-4e33-9e52-1188d0162fc1-kube-api-access-hdgvp\") pod \"kuadrant-operator-catalog-976v7\" (UID: \"e713cbac-ccdc-4e33-9e52-1188d0162fc1\") " pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:17.734352 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.734328 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:17.875760 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:17.875737 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-976v7"] Jul 08 18:25:17.877627 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:17.877598 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode713cbac_ccdc_4e33_9e52_1188d0162fc1.slice/crio-00f225b20eb47bf9e7b72fe5aaec2b4a3ed3af13c8f449863fb9cc2d744cb566 WatchSource:0}: Error finding container 00f225b20eb47bf9e7b72fe5aaec2b4a3ed3af13c8f449863fb9cc2d744cb566: Status 404 returned error can't find the container with id 00f225b20eb47bf9e7b72fe5aaec2b4a3ed3af13c8f449863fb9cc2d744cb566 Jul 08 18:25:18.128391 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.128359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-976v7" event={"ID":"e713cbac-ccdc-4e33-9e52-1188d0162fc1","Type":"ContainerStarted","Data":"00f225b20eb47bf9e7b72fe5aaec2b4a3ed3af13c8f449863fb9cc2d744cb566"} Jul 08 18:25:18.129687 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.129659 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" event={"ID":"eb37ef8c-507b-4995-b58d-10d35a9ad104","Type":"ContainerStarted","Data":"7f2cf6f1fd5e96998075119417728a2cfeb84af75da2d351c23a5485be5b3b67"} Jul 08 18:25:18.755784 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.755649 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-557c9f5c54-qgzxt"] Jul 08 18:25:18.765473 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.765445 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.782105 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.782074 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c9f5c54-qgzxt"] Jul 08 18:25:18.879760 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.879730 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-trusted-ca-bundle\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.880238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.879993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8g2\" (UniqueName: \"kubernetes.io/projected/adb03876-b86b-4ec9-a283-511964f8e136-kube-api-access-cf8g2\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.880238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.880033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-oauth-serving-cert\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.880238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.880070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-console-config\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.880238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.880166 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb03876-b86b-4ec9-a283-511964f8e136-console-serving-cert\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.880238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.880200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-service-ca\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.880535 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.880305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb03876-b86b-4ec9-a283-511964f8e136-console-oauth-config\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.981326 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.981299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-trusted-ca-bundle\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.981482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.981340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8g2\" (UniqueName: \"kubernetes.io/projected/adb03876-b86b-4ec9-a283-511964f8e136-kube-api-access-cf8g2\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.981482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.981367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-oauth-serving-cert\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.981482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.981397 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-console-config\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.981482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.981433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb03876-b86b-4ec9-a283-511964f8e136-console-serving-cert\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.981482 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.981453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-service-ca\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.981738 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.981540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb03876-b86b-4ec9-a283-511964f8e136-console-oauth-config\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.982226 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.982168 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-console-config\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.982226 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.982209 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-trusted-ca-bundle\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.982410 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.982387 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-service-ca\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.982615 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.982585 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/adb03876-b86b-4ec9-a283-511964f8e136-oauth-serving-cert\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.984189 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.984167 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/adb03876-b86b-4ec9-a283-511964f8e136-console-oauth-config\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.984737 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.984718 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/adb03876-b86b-4ec9-a283-511964f8e136-console-serving-cert\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:18.990202 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:18.990182 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8g2\" (UniqueName: \"kubernetes.io/projected/adb03876-b86b-4ec9-a283-511964f8e136-kube-api-access-cf8g2\") pod \"console-557c9f5c54-qgzxt\" (UID: \"adb03876-b86b-4ec9-a283-511964f8e136\") " pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:19.079536 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:19.079453 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:19.241426 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:19.241393 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-557c9f5c54-qgzxt"] Jul 08 18:25:19.518664 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:19.518595 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb03876_b86b_4ec9_a283_511964f8e136.slice/crio-a82148869cccbb80ba6c88694ded6fe60e528866d44cafc98f939ac75342ee44 WatchSource:0}: Error finding container a82148869cccbb80ba6c88694ded6fe60e528866d44cafc98f939ac75342ee44: Status 404 returned error can't find the container with id a82148869cccbb80ba6c88694ded6fe60e528866d44cafc98f939ac75342ee44 Jul 08 18:25:20.143182 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.143145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-976v7" event={"ID":"e713cbac-ccdc-4e33-9e52-1188d0162fc1","Type":"ContainerStarted","Data":"e659be0e07e81ec198515f0a2b08e6c03cb14c545e74ed17ed39e0924a35bb41"} Jul 08 18:25:20.144714 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.144686 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" event={"ID":"eb37ef8c-507b-4995-b58d-10d35a9ad104","Type":"ContainerStarted","Data":"8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4"} Jul 08 18:25:20.144830 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.144753 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" podUID="eb37ef8c-507b-4995-b58d-10d35a9ad104" containerName="registry-server" containerID="cri-o://8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4" gracePeriod=2 Jul 08 18:25:20.146381 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.146359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c9f5c54-qgzxt" event={"ID":"adb03876-b86b-4ec9-a283-511964f8e136","Type":"ContainerStarted","Data":"1c642cf732cad0625adec468ae117a46c6bed2c6d6153f2ea97ae45630f0f41c"} Jul 08 18:25:20.146476 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.146396 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-557c9f5c54-qgzxt" event={"ID":"adb03876-b86b-4ec9-a283-511964f8e136","Type":"ContainerStarted","Data":"a82148869cccbb80ba6c88694ded6fe60e528866d44cafc98f939ac75342ee44"} Jul 08 18:25:20.159535 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.159488 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-976v7" podStartSLOduration=1.426564337 podStartE2EDuration="3.159472869s" totalImagesPullingTime="1.732908532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:25:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:25:20.15816204 +0000 UTC m=+532.900230593" watchObservedRunningTime="2026-07-08 18:25:20.159472869 +0000 UTC m=+532.901541421" Jul 08 18:25:20.174115 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.174063 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" podStartSLOduration=1.855259367 podStartE2EDuration="4.174047637s" totalImagesPullingTime="2.31878827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:25:20.173013977 +0000 UTC m=+532.915082557" watchObservedRunningTime="2026-07-08 18:25:20.174047637 +0000 UTC m=+532.916116191" Jul 08 18:25:20.191510 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.191474 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-557c9f5c54-qgzxt" podStartSLOduration=2.191462984 podStartE2EDuration="2.191462984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:25:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:25:20.190504414 +0000 UTC m=+532.932573000" watchObservedRunningTime="2026-07-08 18:25:20.191462984 +0000 UTC m=+532.933531535" Jul 08 18:25:20.385521 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.385500 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" Jul 08 18:25:20.494634 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.494579 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qswfv\" (UniqueName: \"kubernetes.io/projected/eb37ef8c-507b-4995-b58d-10d35a9ad104-kube-api-access-qswfv\") pod \"eb37ef8c-507b-4995-b58d-10d35a9ad104\" (UID: \"eb37ef8c-507b-4995-b58d-10d35a9ad104\") " Jul 08 18:25:20.496630 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.496603 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb37ef8c-507b-4995-b58d-10d35a9ad104-kube-api-access-qswfv" (OuterVolumeSpecName: "kube-api-access-qswfv") pod "eb37ef8c-507b-4995-b58d-10d35a9ad104" (UID: "eb37ef8c-507b-4995-b58d-10d35a9ad104"). InnerVolumeSpecName "kube-api-access-qswfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:25:20.595234 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:20.595209 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qswfv\" (UniqueName: \"kubernetes.io/projected/eb37ef8c-507b-4995-b58d-10d35a9ad104-kube-api-access-qswfv\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:21.153342 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.153309 2558 generic.go:356] "Generic (PLEG): container finished" podID="eb37ef8c-507b-4995-b58d-10d35a9ad104" containerID="8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4" exitCode=0 Jul 08 18:25:21.153703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.153363 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" Jul 08 18:25:21.153703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.153404 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" event={"ID":"eb37ef8c-507b-4995-b58d-10d35a9ad104","Type":"ContainerDied","Data":"8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4"} Jul 08 18:25:21.153703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.153449 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ww6pp" event={"ID":"eb37ef8c-507b-4995-b58d-10d35a9ad104","Type":"ContainerDied","Data":"7f2cf6f1fd5e96998075119417728a2cfeb84af75da2d351c23a5485be5b3b67"} Jul 08 18:25:21.153703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.153468 2558 scope.go:117] "RemoveContainer" containerID="8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4" Jul 08 18:25:21.163420 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.163402 2558 scope.go:117] "RemoveContainer" containerID="8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4" Jul 08 18:25:21.163669 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:25:21.163653 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4\": container with ID starting with 8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4 not found: ID does not exist" containerID="8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4" Jul 08 18:25:21.163711 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.163676 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4"} err="failed to get container status \"8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4\": rpc error: code = NotFound desc = could not find container \"8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4\": container with ID starting with 8a4103ddfb94b67dee5637496698e34bb4eee1db5e5fabfc85a1ad59e1d797c4 not found: ID does not exist" Jul 08 18:25:21.175114 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.175090 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ww6pp"] Jul 08 18:25:21.179541 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.179520 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ww6pp"] Jul 08 18:25:21.729514 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:21.729480 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb37ef8c-507b-4995-b58d-10d35a9ad104" path="/var/lib/kubelet/pods/eb37ef8c-507b-4995-b58d-10d35a9ad104/volumes" Jul 08 18:25:27.734870 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:27.734839 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:27.735197 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:27.734907 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:27.757580 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:27.757560 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:28.211683 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:28.211659 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-976v7" Jul 08 18:25:29.079907 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:29.079877 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:29.080323 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:29.079934 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:29.084584 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:29.084562 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:29.197678 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:29.197655 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-557c9f5c54-qgzxt" Jul 08 18:25:29.243741 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:29.243715 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd4fcdf68-5p9xc"] Jul 08 18:25:32.221341 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.221309 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq"] Jul 08 18:25:32.221735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.221668 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb37ef8c-507b-4995-b58d-10d35a9ad104" containerName="registry-server" Jul 08 18:25:32.221735 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.221679 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb37ef8c-507b-4995-b58d-10d35a9ad104" containerName="registry-server" Jul 08 18:25:32.221805 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.221743 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb37ef8c-507b-4995-b58d-10d35a9ad104" containerName="registry-server" Jul 08 18:25:32.226420 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.226400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.228745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.228724 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z6ft\"" Jul 08 18:25:32.232674 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.232650 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq"] Jul 08 18:25:32.393378 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.393351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnl4c\" (UniqueName: \"kubernetes.io/projected/ba678a49-d204-4f9b-9f4e-c636256dd173-kube-api-access-rnl4c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.393472 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.393406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.393472 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.393432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.493934 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.493871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnl4c\" (UniqueName: \"kubernetes.io/projected/ba678a49-d204-4f9b-9f4e-c636256dd173-kube-api-access-rnl4c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.493934 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.493924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.494069 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.493944 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.494390 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.494367 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.494451 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.494379 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.501937 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.501916 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnl4c\" (UniqueName: \"kubernetes.io/projected/ba678a49-d204-4f9b-9f4e-c636256dd173-kube-api-access-rnl4c\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.538203 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.538175 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:32.667237 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.667206 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq"] Jul 08 18:25:32.669782 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:32.669758 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba678a49_d204_4f9b_9f4e_c636256dd173.slice/crio-e221689a6a2b8d7b37acb44e540a210e17bcc16e7de98afb210ead8444642ae7 WatchSource:0}: Error finding container e221689a6a2b8d7b37acb44e540a210e17bcc16e7de98afb210ead8444642ae7: Status 404 returned error can't find the container with id e221689a6a2b8d7b37acb44e540a210e17bcc16e7de98afb210ead8444642ae7 Jul 08 18:25:32.823603 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.823575 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5"] Jul 08 18:25:32.826989 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.826973 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:32.835842 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.835813 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5"] Jul 08 18:25:32.998685 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.998656 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:32.998803 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.998699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rgp4\" (UniqueName: \"kubernetes.io/projected/26b37689-af73-48c4-bab8-dfe80a1112d2-kube-api-access-5rgp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:32.998803 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:32.998785 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.099690 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.099629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.099690 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.099669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rgp4\" (UniqueName: \"kubernetes.io/projected/26b37689-af73-48c4-bab8-dfe80a1112d2-kube-api-access-5rgp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.099828 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.099787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.099984 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.099965 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.100072 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.100055 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.107637 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.107617 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rgp4\" (UniqueName: \"kubernetes.io/projected/26b37689-af73-48c4-bab8-dfe80a1112d2-kube-api-access-5rgp4\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.136572 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.136550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:33.216712 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.216683 2558 generic.go:356] "Generic (PLEG): container finished" podID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerID="17eced2f6150ad867f5bc544a48d336680b2d45eac15f17e563f5dfed4e858fe" exitCode=0 Jul 08 18:25:33.216807 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.216765 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" event={"ID":"ba678a49-d204-4f9b-9f4e-c636256dd173","Type":"ContainerDied","Data":"17eced2f6150ad867f5bc544a48d336680b2d45eac15f17e563f5dfed4e858fe"} Jul 08 18:25:33.216843 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.216829 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" event={"ID":"ba678a49-d204-4f9b-9f4e-c636256dd173","Type":"ContainerStarted","Data":"e221689a6a2b8d7b37acb44e540a210e17bcc16e7de98afb210ead8444642ae7"} Jul 08 18:25:33.229693 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.229667 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9"] Jul 08 18:25:33.235082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.235059 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.240231 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.240210 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9"] Jul 08 18:25:33.279739 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.279720 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5"] Jul 08 18:25:33.281631 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:33.281605 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b37689_af73_48c4_bab8_dfe80a1112d2.slice/crio-bdc937a498d4a9641cb7d450ffdade346313a23b9f3523997edb0aa83eee88ae WatchSource:0}: Error finding container bdc937a498d4a9641cb7d450ffdade346313a23b9f3523997edb0aa83eee88ae: Status 404 returned error can't find the container with id bdc937a498d4a9641cb7d450ffdade346313a23b9f3523997edb0aa83eee88ae Jul 08 18:25:33.403447 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.403421 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.403570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.403462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.403656 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.403629 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxktm\" (UniqueName: \"kubernetes.io/projected/8c167a70-4c04-460a-a1ed-1cc988407c91-kube-api-access-bxktm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.504728 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.504696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxktm\" (UniqueName: \"kubernetes.io/projected/8c167a70-4c04-460a-a1ed-1cc988407c91-kube-api-access-bxktm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.504830 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.504758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.504933 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.504914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.505162 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.505141 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.505232 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.505214 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.513540 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.513516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxktm\" (UniqueName: \"kubernetes.io/projected/8c167a70-4c04-460a-a1ed-1cc988407c91-kube-api-access-bxktm\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.547207 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.547186 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:33.624397 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.624372 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq"] Jul 08 18:25:33.628407 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.628346 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.637752 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.637694 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq"] Jul 08 18:25:33.680926 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.680901 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9"] Jul 08 18:25:33.682364 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:33.682331 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c167a70_4c04_460a_a1ed_1cc988407c91.slice/crio-d661374ee0718ab3d97195a8e2121643ae980268e904ea9d9e3cf6717ee02a72 WatchSource:0}: Error finding container d661374ee0718ab3d97195a8e2121643ae980268e904ea9d9e3cf6717ee02a72: Status 404 returned error can't find the container with id d661374ee0718ab3d97195a8e2121643ae980268e904ea9d9e3cf6717ee02a72 Jul 08 18:25:33.707326 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.707304 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.707414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.707342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.707414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.707363 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdfg9\" (UniqueName: \"kubernetes.io/projected/325b1572-576d-438c-be32-fa97515bce37-kube-api-access-zdfg9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.808460 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.808436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.808554 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.808469 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdfg9\" (UniqueName: \"kubernetes.io/projected/325b1572-576d-438c-be32-fa97515bce37-kube-api-access-zdfg9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.808591 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.808569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.808863 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.808842 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.808919 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.808849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.817478 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.817454 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdfg9\" (UniqueName: \"kubernetes.io/projected/325b1572-576d-438c-be32-fa97515bce37-kube-api-access-zdfg9\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:33.943418 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:33.943369 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:34.073370 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.073341 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq"] Jul 08 18:25:34.075812 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:34.075787 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325b1572_576d_438c_be32_fa97515bce37.slice/crio-9700eddfa02c89b02b7c5eddd3215545ed02330a5cbc6515e1ae58ed44e762c9 WatchSource:0}: Error finding container 9700eddfa02c89b02b7c5eddd3215545ed02330a5cbc6515e1ae58ed44e762c9: Status 404 returned error can't find the container with id 9700eddfa02c89b02b7c5eddd3215545ed02330a5cbc6515e1ae58ed44e762c9 Jul 08 18:25:34.223156 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.223086 2558 generic.go:356] "Generic (PLEG): container finished" podID="325b1572-576d-438c-be32-fa97515bce37" containerID="2eca3a0c9457e0cd1f6ebcc4487cf5a8fc1019bea6ada4562fdb9b58a43db838" exitCode=0 Jul 08 18:25:34.223307 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.223172 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" event={"ID":"325b1572-576d-438c-be32-fa97515bce37","Type":"ContainerDied","Data":"2eca3a0c9457e0cd1f6ebcc4487cf5a8fc1019bea6ada4562fdb9b58a43db838"} Jul 08 18:25:34.223307 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.223228 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" event={"ID":"325b1572-576d-438c-be32-fa97515bce37","Type":"ContainerStarted","Data":"9700eddfa02c89b02b7c5eddd3215545ed02330a5cbc6515e1ae58ed44e762c9"} Jul 08 18:25:34.224960 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.224929 2558 generic.go:356] "Generic (PLEG): container finished" podID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerID="358112cf48ee0a36b4e1773eff8791970ef7102873bb47c1e562924bb5414b4a" exitCode=0 Jul 08 18:25:34.225105 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.225057 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" event={"ID":"26b37689-af73-48c4-bab8-dfe80a1112d2","Type":"ContainerDied","Data":"358112cf48ee0a36b4e1773eff8791970ef7102873bb47c1e562924bb5414b4a"} Jul 08 18:25:34.225105 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.225102 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" event={"ID":"26b37689-af73-48c4-bab8-dfe80a1112d2","Type":"ContainerStarted","Data":"bdc937a498d4a9641cb7d450ffdade346313a23b9f3523997edb0aa83eee88ae"} Jul 08 18:25:34.226980 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.226955 2558 generic.go:356] "Generic (PLEG): container finished" podID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerID="6ad14093d6d50b3d47ff436652cf5fb2e42a2806afccab812ac9a38d8590d3bc" exitCode=0 Jul 08 18:25:34.227086 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.226994 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" event={"ID":"8c167a70-4c04-460a-a1ed-1cc988407c91","Type":"ContainerDied","Data":"6ad14093d6d50b3d47ff436652cf5fb2e42a2806afccab812ac9a38d8590d3bc"} Jul 08 18:25:34.227086 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:34.227040 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" event={"ID":"8c167a70-4c04-460a-a1ed-1cc988407c91","Type":"ContainerStarted","Data":"d661374ee0718ab3d97195a8e2121643ae980268e904ea9d9e3cf6717ee02a72"} Jul 08 18:25:35.234412 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:35.234384 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" event={"ID":"8c167a70-4c04-460a-a1ed-1cc988407c91","Type":"ContainerStarted","Data":"c2a255e1bd522a446824a5db8471371da2d1e2741c8892d78b951aec46ef319a"} Jul 08 18:25:35.236425 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:35.236398 2558 generic.go:356] "Generic (PLEG): container finished" podID="325b1572-576d-438c-be32-fa97515bce37" containerID="99775fa4f80d7fcbd06a1eb82c8e7d391ec20e6169a77320daa0f62be6646b48" exitCode=0 Jul 08 18:25:35.236506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:35.236471 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" event={"ID":"325b1572-576d-438c-be32-fa97515bce37","Type":"ContainerDied","Data":"99775fa4f80d7fcbd06a1eb82c8e7d391ec20e6169a77320daa0f62be6646b48"} Jul 08 18:25:35.238782 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:35.238758 2558 generic.go:356] "Generic (PLEG): container finished" podID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerID="5c19351b845cf4379ea767a0ed2a79f8a191e1edb1971bbf47cd550ec29b2f10" exitCode=0 Jul 08 18:25:35.238870 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:35.238822 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" event={"ID":"ba678a49-d204-4f9b-9f4e-c636256dd173","Type":"ContainerDied","Data":"5c19351b845cf4379ea767a0ed2a79f8a191e1edb1971bbf47cd550ec29b2f10"} Jul 08 18:25:36.247179 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.247142 2558 generic.go:356] "Generic (PLEG): container finished" podID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerID="d14357d3d565778b5b281c06f72050474d298bb6d09bdd65a375896e386f87b0" exitCode=0 Jul 08 18:25:36.247629 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.247240 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" event={"ID":"ba678a49-d204-4f9b-9f4e-c636256dd173","Type":"ContainerDied","Data":"d14357d3d565778b5b281c06f72050474d298bb6d09bdd65a375896e386f87b0"} Jul 08 18:25:36.249414 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.249388 2558 generic.go:356] "Generic (PLEG): container finished" podID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerID="c2a255e1bd522a446824a5db8471371da2d1e2741c8892d78b951aec46ef319a" exitCode=0 Jul 08 18:25:36.249560 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.249464 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" event={"ID":"8c167a70-4c04-460a-a1ed-1cc988407c91","Type":"ContainerDied","Data":"c2a255e1bd522a446824a5db8471371da2d1e2741c8892d78b951aec46ef319a"} Jul 08 18:25:36.252510 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.252482 2558 generic.go:356] "Generic (PLEG): container finished" podID="325b1572-576d-438c-be32-fa97515bce37" containerID="0007a181244a763a280437d83e83a633c11dee71b71d14c6a7198fb2b13c6629" exitCode=0 Jul 08 18:25:36.252624 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.252568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" event={"ID":"325b1572-576d-438c-be32-fa97515bce37","Type":"ContainerDied","Data":"0007a181244a763a280437d83e83a633c11dee71b71d14c6a7198fb2b13c6629"} Jul 08 18:25:36.254741 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.254717 2558 generic.go:356] "Generic (PLEG): container finished" podID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerID="5e7094303ea3e6698d2384cdb7d5f6650771ca03c1ca9455f68c36129ddecc8e" exitCode=0 Jul 08 18:25:36.254852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:36.254766 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" event={"ID":"26b37689-af73-48c4-bab8-dfe80a1112d2","Type":"ContainerDied","Data":"5e7094303ea3e6698d2384cdb7d5f6650771ca03c1ca9455f68c36129ddecc8e"} Jul 08 18:25:37.267032 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.266992 2558 generic.go:356] "Generic (PLEG): container finished" podID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerID="ebfa6daea420d9ffc5330ec260c9c9350bd9b7a523cb998e2c8fcb60b19c1a20" exitCode=0 Jul 08 18:25:37.267498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.267085 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" event={"ID":"26b37689-af73-48c4-bab8-dfe80a1112d2","Type":"ContainerDied","Data":"ebfa6daea420d9ffc5330ec260c9c9350bd9b7a523cb998e2c8fcb60b19c1a20"} Jul 08 18:25:37.269723 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.269691 2558 generic.go:356] "Generic (PLEG): container finished" podID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerID="9f5898e953de3e1b5def0ad0b41f0a0fcbbe41d626e754f2fd15475473567503" exitCode=0 Jul 08 18:25:37.269884 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.269761 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" event={"ID":"8c167a70-4c04-460a-a1ed-1cc988407c91","Type":"ContainerDied","Data":"9f5898e953de3e1b5def0ad0b41f0a0fcbbe41d626e754f2fd15475473567503"} Jul 08 18:25:37.417304 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.417266 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:37.440006 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.439983 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:37.549074 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549007 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-util\") pod \"ba678a49-d204-4f9b-9f4e-c636256dd173\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " Jul 08 18:25:37.549074 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549055 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-util\") pod \"325b1572-576d-438c-be32-fa97515bce37\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " Jul 08 18:25:37.549283 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549084 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-bundle\") pod \"325b1572-576d-438c-be32-fa97515bce37\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " Jul 08 18:25:37.549283 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549137 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnl4c\" (UniqueName: \"kubernetes.io/projected/ba678a49-d204-4f9b-9f4e-c636256dd173-kube-api-access-rnl4c\") pod \"ba678a49-d204-4f9b-9f4e-c636256dd173\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " Jul 08 18:25:37.549283 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549153 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdfg9\" (UniqueName: \"kubernetes.io/projected/325b1572-576d-438c-be32-fa97515bce37-kube-api-access-zdfg9\") pod \"325b1572-576d-438c-be32-fa97515bce37\" (UID: \"325b1572-576d-438c-be32-fa97515bce37\") " Jul 08 18:25:37.549283 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549175 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-bundle\") pod \"ba678a49-d204-4f9b-9f4e-c636256dd173\" (UID: \"ba678a49-d204-4f9b-9f4e-c636256dd173\") " Jul 08 18:25:37.549799 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549772 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-bundle" (OuterVolumeSpecName: "bundle") pod "325b1572-576d-438c-be32-fa97515bce37" (UID: "325b1572-576d-438c-be32-fa97515bce37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:37.549881 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.549802 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-bundle" (OuterVolumeSpecName: "bundle") pod "ba678a49-d204-4f9b-9f4e-c636256dd173" (UID: "ba678a49-d204-4f9b-9f4e-c636256dd173"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:37.551594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.551568 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325b1572-576d-438c-be32-fa97515bce37-kube-api-access-zdfg9" (OuterVolumeSpecName: "kube-api-access-zdfg9") pod "325b1572-576d-438c-be32-fa97515bce37" (UID: "325b1572-576d-438c-be32-fa97515bce37"). InnerVolumeSpecName "kube-api-access-zdfg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:25:37.551731 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.551705 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba678a49-d204-4f9b-9f4e-c636256dd173-kube-api-access-rnl4c" (OuterVolumeSpecName: "kube-api-access-rnl4c") pod "ba678a49-d204-4f9b-9f4e-c636256dd173" (UID: "ba678a49-d204-4f9b-9f4e-c636256dd173"). InnerVolumeSpecName "kube-api-access-rnl4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:25:37.555237 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.555215 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-util" (OuterVolumeSpecName: "util") pod "325b1572-576d-438c-be32-fa97515bce37" (UID: "325b1572-576d-438c-be32-fa97515bce37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:37.555803 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.555783 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-util" (OuterVolumeSpecName: "util") pod "ba678a49-d204-4f9b-9f4e-c636256dd173" (UID: "ba678a49-d204-4f9b-9f4e-c636256dd173"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:37.650769 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.650747 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-util\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:37.650769 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.650769 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b1572-576d-438c-be32-fa97515bce37-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:37.650882 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.650779 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnl4c\" (UniqueName: \"kubernetes.io/projected/ba678a49-d204-4f9b-9f4e-c636256dd173-kube-api-access-rnl4c\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:37.650882 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.650789 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdfg9\" (UniqueName: \"kubernetes.io/projected/325b1572-576d-438c-be32-fa97515bce37-kube-api-access-zdfg9\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:37.650882 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.650798 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:37.650882 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:37.650806 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba678a49-d204-4f9b-9f4e-c636256dd173-util\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:38.278049 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.278018 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" Jul 08 18:25:38.278049 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.278043 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq" event={"ID":"325b1572-576d-438c-be32-fa97515bce37","Type":"ContainerDied","Data":"9700eddfa02c89b02b7c5eddd3215545ed02330a5cbc6515e1ae58ed44e762c9"} Jul 08 18:25:38.278562 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.278092 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9700eddfa02c89b02b7c5eddd3215545ed02330a5cbc6515e1ae58ed44e762c9" Jul 08 18:25:38.280751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.280726 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" Jul 08 18:25:38.280751 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.280739 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq" event={"ID":"ba678a49-d204-4f9b-9f4e-c636256dd173","Type":"ContainerDied","Data":"e221689a6a2b8d7b37acb44e540a210e17bcc16e7de98afb210ead8444642ae7"} Jul 08 18:25:38.280935 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.280781 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e221689a6a2b8d7b37acb44e540a210e17bcc16e7de98afb210ead8444642ae7" Jul 08 18:25:38.415647 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.415620 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:38.452204 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.452181 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:38.558928 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.558858 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-bundle\") pod \"8c167a70-4c04-460a-a1ed-1cc988407c91\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " Jul 08 18:25:38.558928 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.558919 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-util\") pod \"8c167a70-4c04-460a-a1ed-1cc988407c91\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " Jul 08 18:25:38.559116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.558949 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxktm\" (UniqueName: \"kubernetes.io/projected/8c167a70-4c04-460a-a1ed-1cc988407c91-kube-api-access-bxktm\") pod \"8c167a70-4c04-460a-a1ed-1cc988407c91\" (UID: \"8c167a70-4c04-460a-a1ed-1cc988407c91\") " Jul 08 18:25:38.559116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.558987 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-bundle\") pod \"26b37689-af73-48c4-bab8-dfe80a1112d2\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " Jul 08 18:25:38.559116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.559025 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rgp4\" (UniqueName: \"kubernetes.io/projected/26b37689-af73-48c4-bab8-dfe80a1112d2-kube-api-access-5rgp4\") pod \"26b37689-af73-48c4-bab8-dfe80a1112d2\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " Jul 08 18:25:38.559116 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.559075 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-util\") pod \"26b37689-af73-48c4-bab8-dfe80a1112d2\" (UID: \"26b37689-af73-48c4-bab8-dfe80a1112d2\") " Jul 08 18:25:38.559643 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.559614 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-bundle" (OuterVolumeSpecName: "bundle") pod "8c167a70-4c04-460a-a1ed-1cc988407c91" (UID: "8c167a70-4c04-460a-a1ed-1cc988407c91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:38.559750 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.559732 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-bundle" (OuterVolumeSpecName: "bundle") pod "26b37689-af73-48c4-bab8-dfe80a1112d2" (UID: "26b37689-af73-48c4-bab8-dfe80a1112d2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:38.561178 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.561153 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b37689-af73-48c4-bab8-dfe80a1112d2-kube-api-access-5rgp4" (OuterVolumeSpecName: "kube-api-access-5rgp4") pod "26b37689-af73-48c4-bab8-dfe80a1112d2" (UID: "26b37689-af73-48c4-bab8-dfe80a1112d2"). InnerVolumeSpecName "kube-api-access-5rgp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:25:38.561390 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.561365 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c167a70-4c04-460a-a1ed-1cc988407c91-kube-api-access-bxktm" (OuterVolumeSpecName: "kube-api-access-bxktm") pod "8c167a70-4c04-460a-a1ed-1cc988407c91" (UID: "8c167a70-4c04-460a-a1ed-1cc988407c91"). InnerVolumeSpecName "kube-api-access-bxktm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:25:38.565587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.565567 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-util" (OuterVolumeSpecName: "util") pod "8c167a70-4c04-460a-a1ed-1cc988407c91" (UID: "8c167a70-4c04-460a-a1ed-1cc988407c91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:38.568752 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.568729 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-util" (OuterVolumeSpecName: "util") pod "26b37689-af73-48c4-bab8-dfe80a1112d2" (UID: "26b37689-af73-48c4-bab8-dfe80a1112d2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:25:38.659839 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.659814 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rgp4\" (UniqueName: \"kubernetes.io/projected/26b37689-af73-48c4-bab8-dfe80a1112d2-kube-api-access-5rgp4\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:38.659839 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.659837 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-util\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:38.659961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.659847 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:38.659961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.659855 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c167a70-4c04-460a-a1ed-1cc988407c91-util\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:38.659961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.659864 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxktm\" (UniqueName: \"kubernetes.io/projected/8c167a70-4c04-460a-a1ed-1cc988407c91-kube-api-access-bxktm\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:38.659961 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:38.659873 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/26b37689-af73-48c4-bab8-dfe80a1112d2-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:39.289535 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:39.289512 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" Jul 08 18:25:39.289932 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:39.289526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9" event={"ID":"8c167a70-4c04-460a-a1ed-1cc988407c91","Type":"ContainerDied","Data":"d661374ee0718ab3d97195a8e2121643ae980268e904ea9d9e3cf6717ee02a72"} Jul 08 18:25:39.289932 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:39.289577 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d661374ee0718ab3d97195a8e2121643ae980268e904ea9d9e3cf6717ee02a72" Jul 08 18:25:39.292067 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:39.292043 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" Jul 08 18:25:39.292178 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:39.292042 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5" event={"ID":"26b37689-af73-48c4-bab8-dfe80a1112d2","Type":"ContainerDied","Data":"bdc937a498d4a9641cb7d450ffdade346313a23b9f3523997edb0aa83eee88ae"} Jul 08 18:25:39.292178 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:39.292169 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bdc937a498d4a9641cb7d450ffdade346313a23b9f3523997edb0aa83eee88ae" Jul 08 18:25:48.161140 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161110 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g"] Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161482 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161495 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161504 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161510 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161517 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerName="pull" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161523 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerName="pull" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161529 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161534 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161541 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325b1572-576d-438c-be32-fa97515bce37" containerName="pull" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161546 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="325b1572-576d-438c-be32-fa97515bce37" containerName="pull" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161556 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325b1572-576d-438c-be32-fa97515bce37" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161561 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="325b1572-576d-438c-be32-fa97515bce37" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161568 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161573 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161579 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161583 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerName="extract" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161589 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161594 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161602 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerName="pull" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161607 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerName="pull" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161616 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325b1572-576d-438c-be32-fa97515bce37" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161620 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="325b1572-576d-438c-be32-fa97515bce37" containerName="util" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161625 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerName="pull" Jul 08 18:25:48.161619 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161630 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerName="pull" Jul 08 18:25:48.162493 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161690 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b37689-af73-48c4-bab8-dfe80a1112d2" containerName="extract" Jul 08 18:25:48.162493 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161698 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba678a49-d204-4f9b-9f4e-c636256dd173" containerName="extract" Jul 08 18:25:48.162493 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161705 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="325b1572-576d-438c-be32-fa97515bce37" containerName="extract" Jul 08 18:25:48.162493 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.161710 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c167a70-4c04-460a-a1ed-1cc988407c91" containerName="extract" Jul 08 18:25:48.166675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.166653 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:25:48.169372 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.169349 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2rw4s\"" Jul 08 18:25:48.174859 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.174831 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g"] Jul 08 18:25:48.231888 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.231867 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcvvw\" (UniqueName: \"kubernetes.io/projected/8235cee0-4ee7-437d-b560-d710bc35a644-kube-api-access-lcvvw\") pod \"limitador-operator-controller-manager-859d7b78bd-d848g\" (UID: \"8235cee0-4ee7-437d-b560-d710bc35a644\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:25:48.333070 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.333045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcvvw\" (UniqueName: \"kubernetes.io/projected/8235cee0-4ee7-437d-b560-d710bc35a644-kube-api-access-lcvvw\") pod \"limitador-operator-controller-manager-859d7b78bd-d848g\" (UID: \"8235cee0-4ee7-437d-b560-d710bc35a644\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:25:48.341233 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.341212 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcvvw\" (UniqueName: \"kubernetes.io/projected/8235cee0-4ee7-437d-b560-d710bc35a644-kube-api-access-lcvvw\") pod \"limitador-operator-controller-manager-859d7b78bd-d848g\" (UID: \"8235cee0-4ee7-437d-b560-d710bc35a644\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:25:48.478746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.478681 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:25:48.611442 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:48.611407 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g"] Jul 08 18:25:48.613743 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:48.613710 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8235cee0_4ee7_437d_b560_d710bc35a644.slice/crio-3a9861a8fc12e41e22cca4f8f2dcf170a7f3fd7e121db3add0873378527ac725 WatchSource:0}: Error finding container 3a9861a8fc12e41e22cca4f8f2dcf170a7f3fd7e121db3add0873378527ac725: Status 404 returned error can't find the container with id 3a9861a8fc12e41e22cca4f8f2dcf170a7f3fd7e121db3add0873378527ac725 Jul 08 18:25:49.351736 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:49.351700 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" event={"ID":"8235cee0-4ee7-437d-b560-d710bc35a644","Type":"ContainerStarted","Data":"3a9861a8fc12e41e22cca4f8f2dcf170a7f3fd7e121db3add0873378527ac725"} Jul 08 18:25:51.364184 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:51.364146 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" event={"ID":"8235cee0-4ee7-437d-b560-d710bc35a644","Type":"ContainerStarted","Data":"df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308"} Jul 08 18:25:51.364635 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:51.364220 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:25:51.380710 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:51.380668 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" podStartSLOduration=1.365485713 podStartE2EDuration="3.380652264s" totalImagesPullingTime="2.015166551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:25:51.379683955 +0000 UTC m=+564.121752507" watchObservedRunningTime="2026-07-08 18:25:51.380652264 +0000 UTC m=+564.122720879" Jul 08 18:25:52.190786 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.190750 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn"] Jul 08 18:25:52.194081 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.194059 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" Jul 08 18:25:52.196542 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.196516 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tqrht\"" Jul 08 18:25:52.204444 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.204416 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn"] Jul 08 18:25:52.272076 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.272047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgkfk\" (UniqueName: \"kubernetes.io/projected/457e2144-f0d1-4c7e-a328-bd433b6fe822-kube-api-access-vgkfk\") pod \"authorino-operator-75cc8d5cb7-gg6pn\" (UID: \"457e2144-f0d1-4c7e-a328-bd433b6fe822\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" Jul 08 18:25:52.372889 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.372860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgkfk\" (UniqueName: \"kubernetes.io/projected/457e2144-f0d1-4c7e-a328-bd433b6fe822-kube-api-access-vgkfk\") pod \"authorino-operator-75cc8d5cb7-gg6pn\" (UID: \"457e2144-f0d1-4c7e-a328-bd433b6fe822\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" Jul 08 18:25:52.391501 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.391471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgkfk\" (UniqueName: \"kubernetes.io/projected/457e2144-f0d1-4c7e-a328-bd433b6fe822-kube-api-access-vgkfk\") pod \"authorino-operator-75cc8d5cb7-gg6pn\" (UID: \"457e2144-f0d1-4c7e-a328-bd433b6fe822\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" Jul 08 18:25:52.506157 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.506100 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" Jul 08 18:25:52.644694 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:52.644669 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn"] Jul 08 18:25:52.647521 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:25:52.647491 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457e2144_f0d1_4c7e_a328_bd433b6fe822.slice/crio-ccbf6737f23dd1a232b64dd1d7389801e95cb83a23c70941dde60c3fd48291de WatchSource:0}: Error finding container ccbf6737f23dd1a232b64dd1d7389801e95cb83a23c70941dde60c3fd48291de: Status 404 returned error can't find the container with id ccbf6737f23dd1a232b64dd1d7389801e95cb83a23c70941dde60c3fd48291de Jul 08 18:25:53.377598 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:53.377561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" event={"ID":"457e2144-f0d1-4c7e-a328-bd433b6fe822","Type":"ContainerStarted","Data":"ccbf6737f23dd1a232b64dd1d7389801e95cb83a23c70941dde60c3fd48291de"} Jul 08 18:25:54.266822 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:54.266773 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fd4fcdf68-5p9xc" podUID="b7b729c8-1609-4076-b7c7-b0a169fa64d4" containerName="console" containerID="cri-o://12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8" gracePeriod=15 Jul 08 18:25:55.032263 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.032229 2558 patch_prober.go:28] interesting pod/console-7fd4fcdf68-5p9xc container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.27:8443/health\": dial tcp 10.133.0.27:8443: connect: connection refused" start-of-body= Jul 08 18:25:55.032644 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.032294 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7fd4fcdf68-5p9xc" podUID="b7b729c8-1609-4076-b7c7-b0a169fa64d4" containerName="console" probeResult="failure" output="Get \"https://10.133.0.27:8443/health\": dial tcp 10.133.0.27:8443: connect: connection refused" Jul 08 18:25:55.139536 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.139516 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:25:55.199447 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199418 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-config\") pod \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " Jul 08 18:25:55.199574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199458 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-trusted-ca-bundle\") pod \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " Jul 08 18:25:55.199574 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199513 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-serving-cert\") pod \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " Jul 08 18:25:55.199671 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199579 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-oauth-serving-cert\") pod \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " Jul 08 18:25:55.199671 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199604 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-service-ca\") pod \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " Jul 08 18:25:55.199671 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199657 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-oauth-config\") pod \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " Jul 08 18:25:55.199820 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199711 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6tcc\" (UniqueName: \"kubernetes.io/projected/b7b729c8-1609-4076-b7c7-b0a169fa64d4-kube-api-access-m6tcc\") pod \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\" (UID: \"b7b729c8-1609-4076-b7c7-b0a169fa64d4\") " Jul 08 18:25:55.199930 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.199893 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-config" (OuterVolumeSpecName: "console-config") pod "b7b729c8-1609-4076-b7c7-b0a169fa64d4" (UID: "b7b729c8-1609-4076-b7c7-b0a169fa64d4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:25:55.200067 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.200034 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-service-ca" (OuterVolumeSpecName: "service-ca") pod "b7b729c8-1609-4076-b7c7-b0a169fa64d4" (UID: "b7b729c8-1609-4076-b7c7-b0a169fa64d4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:25:55.200067 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.200051 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b7b729c8-1609-4076-b7c7-b0a169fa64d4" (UID: "b7b729c8-1609-4076-b7c7-b0a169fa64d4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:25:55.200177 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.200105 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b7b729c8-1609-4076-b7c7-b0a169fa64d4" (UID: "b7b729c8-1609-4076-b7c7-b0a169fa64d4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:25:55.201725 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.201704 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b7b729c8-1609-4076-b7c7-b0a169fa64d4" (UID: "b7b729c8-1609-4076-b7c7-b0a169fa64d4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:25:55.201815 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.201734 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b7b729c8-1609-4076-b7c7-b0a169fa64d4" (UID: "b7b729c8-1609-4076-b7c7-b0a169fa64d4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:25:55.201815 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.201756 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b729c8-1609-4076-b7c7-b0a169fa64d4-kube-api-access-m6tcc" (OuterVolumeSpecName: "kube-api-access-m6tcc") pod "b7b729c8-1609-4076-b7c7-b0a169fa64d4" (UID: "b7b729c8-1609-4076-b7c7-b0a169fa64d4"). InnerVolumeSpecName "kube-api-access-m6tcc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:25:55.300369 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.300315 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:55.300369 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.300336 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-trusted-ca-bundle\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:55.300369 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.300346 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:55.300369 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.300355 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-oauth-serving-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:55.300369 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.300363 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b7b729c8-1609-4076-b7c7-b0a169fa64d4-service-ca\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:55.300369 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.300371 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b7b729c8-1609-4076-b7c7-b0a169fa64d4-console-oauth-config\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:55.300617 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.300380 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6tcc\" (UniqueName: \"kubernetes.io/projected/b7b729c8-1609-4076-b7c7-b0a169fa64d4-kube-api-access-m6tcc\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:25:55.390335 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.390308 2558 generic.go:356] "Generic (PLEG): container finished" podID="b7b729c8-1609-4076-b7c7-b0a169fa64d4" containerID="12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8" exitCode=0 Jul 08 18:25:55.390503 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.390413 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fd4fcdf68-5p9xc" Jul 08 18:25:55.390503 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.390456 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4fcdf68-5p9xc" event={"ID":"b7b729c8-1609-4076-b7c7-b0a169fa64d4","Type":"ContainerDied","Data":"12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8"} Jul 08 18:25:55.390590 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.390514 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fd4fcdf68-5p9xc" event={"ID":"b7b729c8-1609-4076-b7c7-b0a169fa64d4","Type":"ContainerDied","Data":"3a954a7cfeda3eef1922228842f245717bff5de3d99ac5e1bbf7b1562f258b02"} Jul 08 18:25:55.390590 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.390543 2558 scope.go:117] "RemoveContainer" containerID="12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8" Jul 08 18:25:55.392214 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.392188 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" event={"ID":"457e2144-f0d1-4c7e-a328-bd433b6fe822","Type":"ContainerStarted","Data":"4c9db2f1cc7459096e09177536e022d00f28fbc3cbefc86eb278a0946a8a9917"} Jul 08 18:25:55.392320 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.392250 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" Jul 08 18:25:55.400039 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.400024 2558 scope.go:117] "RemoveContainer" containerID="12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8" Jul 08 18:25:55.400287 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:25:55.400252 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8\": container with ID starting with 12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8 not found: ID does not exist" containerID="12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8" Jul 08 18:25:55.400342 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.400299 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8"} err="failed to get container status \"12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8\": rpc error: code = NotFound desc = could not find container \"12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8\": container with ID starting with 12f60446403e9d70624de14b7432807ad1a40961fc48f214d6c548f6a377e5c8 not found: ID does not exist" Jul 08 18:25:55.417150 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.417112 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" podStartSLOduration=1.017723732 podStartE2EDuration="3.417101736s" totalImagesPullingTime="2.399378004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:25:55.415628707 +0000 UTC m=+568.157697288" watchObservedRunningTime="2026-07-08 18:25:55.417101736 +0000 UTC m=+568.159170287" Jul 08 18:25:55.441260 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.437380 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fd4fcdf68-5p9xc"] Jul 08 18:25:55.444929 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.444908 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fd4fcdf68-5p9xc"] Jul 08 18:25:55.728979 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:25:55.728945 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7b729c8-1609-4076-b7c7-b0a169fa64d4" path="/var/lib/kubelet/pods/b7b729c8-1609-4076-b7c7-b0a169fa64d4/volumes" Jul 08 18:26:02.372855 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:02.372816 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:26:06.401159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:06.401125 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gg6pn" Jul 08 18:26:10.352893 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.352855 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb"] Jul 08 18:26:10.353467 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.353446 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b729c8-1609-4076-b7c7-b0a169fa64d4" containerName="console" Jul 08 18:26:10.353554 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.353471 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b729c8-1609-4076-b7c7-b0a169fa64d4" containerName="console" Jul 08 18:26:10.353615 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.353597 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b729c8-1609-4076-b7c7-b0a169fa64d4" containerName="console" Jul 08 18:26:10.358538 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.358513 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.361237 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.361200 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 18:26:10.361237 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.361230 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 18:26:10.362076 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.362047 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9z6ft\"" Jul 08 18:26:10.364668 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.364640 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb"] Jul 08 18:26:10.418114 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.418090 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v87cx\" (UniqueName: \"kubernetes.io/projected/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-kube-api-access-v87cx\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.418230 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.418122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.418230 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.418172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.518814 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.518790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v87cx\" (UniqueName: \"kubernetes.io/projected/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-kube-api-access-v87cx\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.518922 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.518820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.518922 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.518862 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.519439 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.519409 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.521082 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.521064 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.529362 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.529346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v87cx\" (UniqueName: \"kubernetes.io/projected/24d1d875-cfa9-4418-a7d3-6f9167f6ac9f-kube-api-access-v87cx\") pod \"kuadrant-console-plugin-66b5774985-k95jb\" (UID: \"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.670065 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.670043 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" Jul 08 18:26:10.801628 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:10.801602 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb"] Jul 08 18:26:10.803442 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:26:10.803396 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24d1d875_cfa9_4418_a7d3_6f9167f6ac9f.slice/crio-81d1620d4b0e29988fa1ef25c45a34b8a048efa1b10498fdaa12be344fbd1c34 WatchSource:0}: Error finding container 81d1620d4b0e29988fa1ef25c45a34b8a048efa1b10498fdaa12be344fbd1c34: Status 404 returned error can't find the container with id 81d1620d4b0e29988fa1ef25c45a34b8a048efa1b10498fdaa12be344fbd1c34 Jul 08 18:26:11.484762 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:11.484726 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" event={"ID":"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f","Type":"ContainerStarted","Data":"81d1620d4b0e29988fa1ef25c45a34b8a048efa1b10498fdaa12be344fbd1c34"} Jul 08 18:26:21.004675 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.004628 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g"] Jul 08 18:26:21.005854 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.004912 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" containerName="manager" containerID="cri-o://df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308" gracePeriod=2 Jul 08 18:26:21.013815 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.013259 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g"] Jul 08 18:26:21.036237 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.036213 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2"] Jul 08 18:26:21.036708 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.036689 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" containerName="manager" Jul 08 18:26:21.036810 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.036711 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" containerName="manager" Jul 08 18:26:21.036810 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.036797 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" containerName="manager" Jul 08 18:26:21.040203 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.040184 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" Jul 08 18:26:21.051654 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.051610 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2"] Jul 08 18:26:21.064074 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:26:21.064040 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d848g\" is forbidden: User \"system:node:ip-10-0-130-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-158.ec2.internal' and this object" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:26:21.114007 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.113983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94qxs\" (UniqueName: \"kubernetes.io/projected/d154ceab-4d84-4725-b2e3-29408c585ac8-kube-api-access-94qxs\") pod \"limitador-operator-controller-manager-859d7b78bd-tckl2\" (UID: \"d154ceab-4d84-4725-b2e3-29408c585ac8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" Jul 08 18:26:21.214749 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.214710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94qxs\" (UniqueName: \"kubernetes.io/projected/d154ceab-4d84-4725-b2e3-29408c585ac8-kube-api-access-94qxs\") pod \"limitador-operator-controller-manager-859d7b78bd-tckl2\" (UID: \"d154ceab-4d84-4725-b2e3-29408c585ac8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" Jul 08 18:26:21.226877 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.226847 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94qxs\" (UniqueName: \"kubernetes.io/projected/d154ceab-4d84-4725-b2e3-29408c585ac8-kube-api-access-94qxs\") pod \"limitador-operator-controller-manager-859d7b78bd-tckl2\" (UID: \"d154ceab-4d84-4725-b2e3-29408c585ac8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" Jul 08 18:26:21.384168 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:21.384138 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" Jul 08 18:26:33.882629 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:33.882609 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:26:33.884874 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:26:33.884848 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d848g\" is forbidden: User \"system:node:ip-10-0-130-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-158.ec2.internal' and this object" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:26:33.889750 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:33.889728 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2"] Jul 08 18:26:33.890827 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:26:33.890801 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd154ceab_4d84_4725_b2e3_29408c585ac8.slice/crio-df759204b9298566944e3d18d64a7108c494deefb9b6fa99b7b38fe06614a883 WatchSource:0}: Error finding container df759204b9298566944e3d18d64a7108c494deefb9b6fa99b7b38fe06614a883: Status 404 returned error can't find the container with id df759204b9298566944e3d18d64a7108c494deefb9b6fa99b7b38fe06614a883 Jul 08 18:26:33.935435 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:33.935414 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcvvw\" (UniqueName: \"kubernetes.io/projected/8235cee0-4ee7-437d-b560-d710bc35a644-kube-api-access-lcvvw\") pod \"8235cee0-4ee7-437d-b560-d710bc35a644\" (UID: \"8235cee0-4ee7-437d-b560-d710bc35a644\") " Jul 08 18:26:33.937216 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:33.937192 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8235cee0-4ee7-437d-b560-d710bc35a644-kube-api-access-lcvvw" (OuterVolumeSpecName: "kube-api-access-lcvvw") pod "8235cee0-4ee7-437d-b560-d710bc35a644" (UID: "8235cee0-4ee7-437d-b560-d710bc35a644"). InnerVolumeSpecName "kube-api-access-lcvvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:26:34.036613 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.036559 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcvvw\" (UniqueName: \"kubernetes.io/projected/8235cee0-4ee7-437d-b560-d710bc35a644-kube-api-access-lcvvw\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:26:34.636622 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.636591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" event={"ID":"d154ceab-4d84-4725-b2e3-29408c585ac8","Type":"ContainerStarted","Data":"3e5d6662d369c83e7b624a284fde61467b5f64fd9a6223abf53eac168b2a88b1"} Jul 08 18:26:34.637897 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.636652 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" event={"ID":"d154ceab-4d84-4725-b2e3-29408c585ac8","Type":"ContainerStarted","Data":"df759204b9298566944e3d18d64a7108c494deefb9b6fa99b7b38fe06614a883"} Jul 08 18:26:34.637897 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.636683 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" Jul 08 18:26:34.638040 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.637893 2558 generic.go:356] "Generic (PLEG): container finished" podID="8235cee0-4ee7-437d-b560-d710bc35a644" containerID="df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308" exitCode=0 Jul 08 18:26:34.638040 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.637934 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:26:34.638040 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.637946 2558 scope.go:117] "RemoveContainer" containerID="df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308" Jul 08 18:26:34.639653 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.639621 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" event={"ID":"24d1d875-cfa9-4418-a7d3-6f9167f6ac9f","Type":"ContainerStarted","Data":"74abc13016d98a17f7a1f45c01c3fe8e256f471e40583540e4d6e42f689e6613"} Jul 08 18:26:34.647156 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.647138 2558 scope.go:117] "RemoveContainer" containerID="df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308" Jul 08 18:26:34.647446 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:26:34.647425 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308\": container with ID starting with df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308 not found: ID does not exist" containerID="df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308" Jul 08 18:26:34.647503 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.647454 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308"} err="failed to get container status \"df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308\": rpc error: code = NotFound desc = could not find container \"df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308\": container with ID starting with df3b3193fd988153b398f2295f5262bf34c362a6a8b5ce7d0995722749bce308 not found: ID does not exist" Jul 08 18:26:34.653669 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.653625 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" podStartSLOduration=13.653609455 podStartE2EDuration="13.653609455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:26:34.652905776 +0000 UTC m=+607.394974370" watchObservedRunningTime="2026-07-08 18:26:34.653609455 +0000 UTC m=+607.395678009" Jul 08 18:26:34.655148 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:26:34.655122 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d848g\" is forbidden: User \"system:node:ip-10-0-130-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-158.ec2.internal' and this object" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:26:34.656945 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:26:34.656922 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-d848g\" is forbidden: User \"system:node:ip-10-0-130-158.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-158.ec2.internal' and this object" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-d848g" Jul 08 18:26:34.678736 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:34.678693 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-k95jb" podStartSLOduration=1.6726533529999998 podStartE2EDuration="24.678680476s" totalImagesPullingTime="23.006027123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:26:34.676988665 +0000 UTC m=+607.419057216" watchObservedRunningTime="2026-07-08 18:26:34.678680476 +0000 UTC m=+607.420749027" Jul 08 18:26:35.729206 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:35.729172 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8235cee0-4ee7-437d-b560-d710bc35a644" path="/var/lib/kubelet/pods/8235cee0-4ee7-437d-b560-d710bc35a644/volumes" Jul 08 18:26:45.648063 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:45.648027 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tckl2" Jul 08 18:26:59.643097 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:26:59.643016 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-g6pxl"] Jul 08 18:27:00.237077 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.237036 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g6pxl"] Jul 08 18:27:00.237265 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.237172 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g6pxl" Jul 08 18:27:00.239884 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.239859 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zdspl\"" Jul 08 18:27:00.350022 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.349983 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbkqv\" (UniqueName: \"kubernetes.io/projected/ecd880d4-0865-4c45-9fdf-638fb82a0ae8-kube-api-access-kbkqv\") pod \"authorino-58cd955675-g6pxl\" (UID: \"ecd880d4-0865-4c45-9fdf-638fb82a0ae8\") " pod="kuadrant-system/authorino-58cd955675-g6pxl" Jul 08 18:27:00.450641 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.450613 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbkqv\" (UniqueName: \"kubernetes.io/projected/ecd880d4-0865-4c45-9fdf-638fb82a0ae8-kube-api-access-kbkqv\") pod \"authorino-58cd955675-g6pxl\" (UID: \"ecd880d4-0865-4c45-9fdf-638fb82a0ae8\") " pod="kuadrant-system/authorino-58cd955675-g6pxl" Jul 08 18:27:00.458165 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.458141 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbkqv\" (UniqueName: \"kubernetes.io/projected/ecd880d4-0865-4c45-9fdf-638fb82a0ae8-kube-api-access-kbkqv\") pod \"authorino-58cd955675-g6pxl\" (UID: \"ecd880d4-0865-4c45-9fdf-638fb82a0ae8\") " pod="kuadrant-system/authorino-58cd955675-g6pxl" Jul 08 18:27:00.548504 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.548448 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g6pxl" Jul 08 18:27:00.693892 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.693870 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-g6pxl"] Jul 08 18:27:00.695989 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:27:00.695956 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecd880d4_0865_4c45_9fdf_638fb82a0ae8.slice/crio-c1556b64b1f1c2017618ab12b07c7056913b4da5d5f8cf8363d76621976dfe04 WatchSource:0}: Error finding container c1556b64b1f1c2017618ab12b07c7056913b4da5d5f8cf8363d76621976dfe04: Status 404 returned error can't find the container with id c1556b64b1f1c2017618ab12b07c7056913b4da5d5f8cf8363d76621976dfe04 Jul 08 18:27:00.791319 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:00.791262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g6pxl" event={"ID":"ecd880d4-0865-4c45-9fdf-638fb82a0ae8","Type":"ContainerStarted","Data":"c1556b64b1f1c2017618ab12b07c7056913b4da5d5f8cf8363d76621976dfe04"} Jul 08 18:27:04.582364 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:04.582335 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g6pxl"] Jul 08 18:27:04.817560 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:04.817525 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g6pxl" event={"ID":"ecd880d4-0865-4c45-9fdf-638fb82a0ae8","Type":"ContainerStarted","Data":"492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a"} Jul 08 18:27:04.831915 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:04.831864 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-g6pxl" podStartSLOduration=2.644881184 podStartE2EDuration="5.831850391s" totalImagesPullingTime="3.186969207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:26:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:04.831234927 +0000 UTC m=+637.573303479" watchObservedRunningTime="2026-07-08 18:27:04.831850391 +0000 UTC m=+637.573918942" Jul 08 18:27:05.822755 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:05.822697 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-g6pxl" podUID="ecd880d4-0865-4c45-9fdf-638fb82a0ae8" containerName="authorino" containerID="cri-o://492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a" gracePeriod=30 Jul 08 18:27:06.094162 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.094141 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g6pxl" Jul 08 18:27:06.203940 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.203917 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbkqv\" (UniqueName: \"kubernetes.io/projected/ecd880d4-0865-4c45-9fdf-638fb82a0ae8-kube-api-access-kbkqv\") pod \"ecd880d4-0865-4c45-9fdf-638fb82a0ae8\" (UID: \"ecd880d4-0865-4c45-9fdf-638fb82a0ae8\") " Jul 08 18:27:06.205844 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.205822 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd880d4-0865-4c45-9fdf-638fb82a0ae8-kube-api-access-kbkqv" (OuterVolumeSpecName: "kube-api-access-kbkqv") pod "ecd880d4-0865-4c45-9fdf-638fb82a0ae8" (UID: "ecd880d4-0865-4c45-9fdf-638fb82a0ae8"). InnerVolumeSpecName "kube-api-access-kbkqv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:27:06.305489 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.305465 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbkqv\" (UniqueName: \"kubernetes.io/projected/ecd880d4-0865-4c45-9fdf-638fb82a0ae8-kube-api-access-kbkqv\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:27:06.828867 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.828833 2558 generic.go:356] "Generic (PLEG): container finished" podID="ecd880d4-0865-4c45-9fdf-638fb82a0ae8" containerID="492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a" exitCode=0 Jul 08 18:27:06.829324 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.828872 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-g6pxl" Jul 08 18:27:06.829324 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.828883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g6pxl" event={"ID":"ecd880d4-0865-4c45-9fdf-638fb82a0ae8","Type":"ContainerDied","Data":"492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a"} Jul 08 18:27:06.829324 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.828933 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-g6pxl" event={"ID":"ecd880d4-0865-4c45-9fdf-638fb82a0ae8","Type":"ContainerDied","Data":"c1556b64b1f1c2017618ab12b07c7056913b4da5d5f8cf8363d76621976dfe04"} Jul 08 18:27:06.829324 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.828949 2558 scope.go:117] "RemoveContainer" containerID="492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a" Jul 08 18:27:06.838765 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.838746 2558 scope.go:117] "RemoveContainer" containerID="492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a" Jul 08 18:27:06.839010 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:27:06.838990 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a\": container with ID starting with 492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a not found: ID does not exist" containerID="492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a" Jul 08 18:27:06.839075 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.839024 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a"} err="failed to get container status \"492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a\": rpc error: code = NotFound desc = could not find container \"492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a\": container with ID starting with 492f86b237ae5ada3ec664c96c9aa23f87bb35082c8dadf8c82304029938901a not found: ID does not exist" Jul 08 18:27:06.851308 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.851287 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-g6pxl"] Jul 08 18:27:06.853347 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:06.853329 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-g6pxl"] Jul 08 18:27:07.729201 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:07.729161 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd880d4-0865-4c45-9fdf-638fb82a0ae8" path="/var/lib/kubelet/pods/ecd880d4-0865-4c45-9fdf-638fb82a0ae8/volumes" Jul 08 18:27:38.038742 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.038709 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77fdddb666-vph9g"] Jul 08 18:27:38.039247 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.039207 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd880d4-0865-4c45-9fdf-638fb82a0ae8" containerName="authorino" Jul 08 18:27:38.039247 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.039224 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd880d4-0865-4c45-9fdf-638fb82a0ae8" containerName="authorino" Jul 08 18:27:38.039377 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.039351 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd880d4-0865-4c45-9fdf-638fb82a0ae8" containerName="authorino" Jul 08 18:27:38.044183 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.044166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.046729 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.046709 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 18:27:38.046852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.046705 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 18:27:38.046852 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.046713 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-scmdl\"" Jul 08 18:27:38.052246 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.052226 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fdddb666-vph9g"] Jul 08 18:27:38.077343 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.077309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert\") pod \"maas-controller-77fdddb666-vph9g\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.077506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.077418 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggz4p\" (UniqueName: \"kubernetes.io/projected/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-kube-api-access-ggz4p\") pod \"maas-controller-77fdddb666-vph9g\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.177906 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.177872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggz4p\" (UniqueName: \"kubernetes.io/projected/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-kube-api-access-ggz4p\") pod \"maas-controller-77fdddb666-vph9g\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.178076 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.177931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert\") pod \"maas-controller-77fdddb666-vph9g\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.178076 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:27:38.178030 2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 08 18:27:38.178150 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:27:38.178096 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert podName:4c4e2df0-4d2f-4775-b469-4caaa2a966c4 nodeName:}" failed. No retries permitted until 2026-07-08 18:27:38.678074937 +0000 UTC m=+671.420143467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert") pod "maas-controller-77fdddb666-vph9g" (UID: "4c4e2df0-4d2f-4775-b469-4caaa2a966c4") : secret "maas-controller-webhook-cert" not found Jul 08 18:27:38.188124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.188091 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggz4p\" (UniqueName: \"kubernetes.io/projected/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-kube-api-access-ggz4p\") pod \"maas-controller-77fdddb666-vph9g\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.688912 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.688852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert\") pod \"maas-controller-77fdddb666-vph9g\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.691865 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.691821 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert\") pod \"maas-controller-77fdddb666-vph9g\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:38.955586 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:38.955488 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:39.297236 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:39.297211 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fdddb666-vph9g"] Jul 08 18:27:39.299156 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:27:39.299131 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4e2df0_4d2f_4775_b469_4caaa2a966c4.slice/crio-2aa2ad643d421a985f597b025e2a5f5d3f641577aa081c93a87197d4a4ba2a14 WatchSource:0}: Error finding container 2aa2ad643d421a985f597b025e2a5f5d3f641577aa081c93a87197d4a4ba2a14: Status 404 returned error can't find the container with id 2aa2ad643d421a985f597b025e2a5f5d3f641577aa081c93a87197d4a4ba2a14 Jul 08 18:27:40.007804 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:40.007762 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fdddb666-vph9g" event={"ID":"4c4e2df0-4d2f-4775-b469-4caaa2a966c4","Type":"ContainerStarted","Data":"2aa2ad643d421a985f597b025e2a5f5d3f641577aa081c93a87197d4a4ba2a14"} Jul 08 18:27:42.020214 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:42.020166 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fdddb666-vph9g" event={"ID":"4c4e2df0-4d2f-4775-b469-4caaa2a966c4","Type":"ContainerStarted","Data":"034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5"} Jul 08 18:27:42.020681 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:42.020289 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:27:42.042977 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:42.042931 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77fdddb666-vph9g" podStartSLOduration=1.805152589 podStartE2EDuration="4.042915443s" totalImagesPullingTime="2.237762854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:27:42.041661711 +0000 UTC m=+674.783730297" watchObservedRunningTime="2026-07-08 18:27:42.042915443 +0000 UTC m=+674.784983994" Jul 08 18:27:53.029643 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:27:53.029608 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:28:18.115571 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.115535 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qx9qd"] Jul 08 18:28:18.121857 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.121834 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.125416 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.125397 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 18:28:18.125599 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.125587 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gvv2k\"" Jul 08 18:28:18.134349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.134325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qx9qd"] Jul 08 18:28:18.138237 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.138214 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9qdwv"] Jul 08 18:28:18.142110 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.142091 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.172752 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.172724 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9qdwv"] Jul 08 18:28:18.223027 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.223001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgn4k\" (UniqueName: \"kubernetes.io/projected/5e904bbc-f336-4df5-8412-f1aecb500ed0-kube-api-access-kgn4k\") pod \"payload-processing-58f86c7798-9qdwv\" (UID: \"5e904bbc-f336-4df5-8412-f1aecb500ed0\") " pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.223160 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.223048 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e904bbc-f336-4df5-8412-f1aecb500ed0-plugins-config-volume\") pod \"payload-processing-58f86c7798-9qdwv\" (UID: \"5e904bbc-f336-4df5-8412-f1aecb500ed0\") " pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.223160 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.223076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acdc84a6-6391-4ad4-84e0-a0da5affa0de-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qx9qd\" (UID: \"acdc84a6-6391-4ad4-84e0-a0da5affa0de\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.223160 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.223128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nm2\" (UniqueName: \"kubernetes.io/projected/acdc84a6-6391-4ad4-84e0-a0da5affa0de-kube-api-access-w9nm2\") pod \"payload-pre-processing-7964457696-qx9qd\" (UID: \"acdc84a6-6391-4ad4-84e0-a0da5affa0de\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.324210 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.324181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgn4k\" (UniqueName: \"kubernetes.io/projected/5e904bbc-f336-4df5-8412-f1aecb500ed0-kube-api-access-kgn4k\") pod \"payload-processing-58f86c7798-9qdwv\" (UID: \"5e904bbc-f336-4df5-8412-f1aecb500ed0\") " pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.324378 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.324217 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e904bbc-f336-4df5-8412-f1aecb500ed0-plugins-config-volume\") pod \"payload-processing-58f86c7798-9qdwv\" (UID: \"5e904bbc-f336-4df5-8412-f1aecb500ed0\") " pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.324378 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.324235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acdc84a6-6391-4ad4-84e0-a0da5affa0de-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qx9qd\" (UID: \"acdc84a6-6391-4ad4-84e0-a0da5affa0de\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.324378 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.324294 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nm2\" (UniqueName: \"kubernetes.io/projected/acdc84a6-6391-4ad4-84e0-a0da5affa0de-kube-api-access-w9nm2\") pod \"payload-pre-processing-7964457696-qx9qd\" (UID: \"acdc84a6-6391-4ad4-84e0-a0da5affa0de\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.324955 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.324936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/acdc84a6-6391-4ad4-84e0-a0da5affa0de-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qx9qd\" (UID: \"acdc84a6-6391-4ad4-84e0-a0da5affa0de\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.325000 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.324981 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5e904bbc-f336-4df5-8412-f1aecb500ed0-plugins-config-volume\") pod \"payload-processing-58f86c7798-9qdwv\" (UID: \"5e904bbc-f336-4df5-8412-f1aecb500ed0\") " pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.332224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.332181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgn4k\" (UniqueName: \"kubernetes.io/projected/5e904bbc-f336-4df5-8412-f1aecb500ed0-kube-api-access-kgn4k\") pod \"payload-processing-58f86c7798-9qdwv\" (UID: \"5e904bbc-f336-4df5-8412-f1aecb500ed0\") " pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.332224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.332220 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nm2\" (UniqueName: \"kubernetes.io/projected/acdc84a6-6391-4ad4-84e0-a0da5affa0de-kube-api-access-w9nm2\") pod \"payload-pre-processing-7964457696-qx9qd\" (UID: \"acdc84a6-6391-4ad4-84e0-a0da5affa0de\") " pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.431479 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.431457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:18.451039 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.451015 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:18.579587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.579491 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qx9qd"] Jul 08 18:28:18.583466 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:28:18.583441 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacdc84a6_6391_4ad4_84e0_a0da5affa0de.slice/crio-e73f6d087dc822c0847255f400a3aa23dc7fe0e97d91eb5767374e35664b313c WatchSource:0}: Error finding container e73f6d087dc822c0847255f400a3aa23dc7fe0e97d91eb5767374e35664b313c: Status 404 returned error can't find the container with id e73f6d087dc822c0847255f400a3aa23dc7fe0e97d91eb5767374e35664b313c Jul 08 18:28:18.586045 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.586025 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:28:18.616658 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:18.616639 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-9qdwv"] Jul 08 18:28:18.617528 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:28:18.617507 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e904bbc_f336_4df5_8412_f1aecb500ed0.slice/crio-06025350de141471df99d7fa58411eaa81da3dea0961896a17390e676c460b66 WatchSource:0}: Error finding container 06025350de141471df99d7fa58411eaa81da3dea0961896a17390e676c460b66: Status 404 returned error can't find the container with id 06025350de141471df99d7fa58411eaa81da3dea0961896a17390e676c460b66 Jul 08 18:28:19.231166 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:19.231131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" event={"ID":"5e904bbc-f336-4df5-8412-f1aecb500ed0","Type":"ContainerStarted","Data":"06025350de141471df99d7fa58411eaa81da3dea0961896a17390e676c460b66"} Jul 08 18:28:19.232385 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:19.232359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" event={"ID":"acdc84a6-6391-4ad4-84e0-a0da5affa0de","Type":"ContainerStarted","Data":"e73f6d087dc822c0847255f400a3aa23dc7fe0e97d91eb5767374e35664b313c"} Jul 08 18:28:21.250701 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:21.250669 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" event={"ID":"5e904bbc-f336-4df5-8412-f1aecb500ed0","Type":"ContainerStarted","Data":"fc977b36f0bbbf4b32aea0ba50a634f2737f62144c21a100474a2fe8b09a9ed3"} Jul 08 18:28:21.251383 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:21.250746 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:21.252305 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:21.252284 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" event={"ID":"acdc84a6-6391-4ad4-84e0-a0da5affa0de","Type":"ContainerStarted","Data":"e19d12fa51c565d44cfbc7101c4b297a66d39f2060b88c91dec18cf4bdea1321"} Jul 08 18:28:21.252397 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:21.252330 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:21.269313 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:21.269255 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" podStartSLOduration=1.647969604 podStartE2EDuration="3.269244061s" totalImagesPullingTime="1.621274457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:28:21.266660054 +0000 UTC m=+714.008728634" watchObservedRunningTime="2026-07-08 18:28:21.269244061 +0000 UTC m=+714.011312611" Jul 08 18:28:21.281214 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:21.281173 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" podStartSLOduration=1.6337807629999999 podStartE2EDuration="3.281160457s" totalImagesPullingTime="1.647379694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:28:21.280994266 +0000 UTC m=+714.023062820" watchObservedRunningTime="2026-07-08 18:28:21.281160457 +0000 UTC m=+714.023229058" Jul 08 18:28:32.260465 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:32.260427 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-9qdwv" Jul 08 18:28:32.260892 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:32.260497 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qx9qd" Jul 08 18:28:47.483368 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.483331 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m"] Jul 08 18:28:47.487008 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.486985 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.490699 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.490673 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 18:28:47.490829 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.490721 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tlxrv\"" Jul 08 18:28:47.490829 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.490733 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 18:28:47.490829 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.490677 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 18:28:47.495648 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.495628 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m"] Jul 08 18:28:47.570858 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.570835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.570953 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.570915 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdde838-120c-4ac8-bf81-71893a4b9f21-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.570953 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.570939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.571035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.570961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2rqp\" (UniqueName: \"kubernetes.io/projected/cfdde838-120c-4ac8-bf81-71893a4b9f21-kube-api-access-b2rqp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.571035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.571005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.571035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.571030 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672260 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdde838-120c-4ac8-bf81-71893a4b9f21-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672363 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672363 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2rqp\" (UniqueName: \"kubernetes.io/projected/cfdde838-120c-4ac8-bf81-71893a4b9f21-kube-api-access-b2rqp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672452 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672362 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672452 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672384 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672452 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672429 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672805 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672902 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.672902 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.672864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.674543 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.674525 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cfdde838-120c-4ac8-bf81-71893a4b9f21-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.674632 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.674619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cfdde838-120c-4ac8-bf81-71893a4b9f21-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.680413 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.680393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2rqp\" (UniqueName: \"kubernetes.io/projected/cfdde838-120c-4ac8-bf81-71893a4b9f21-kube-api-access-b2rqp\") pod \"e2e-distinct-simulated-kserve-59975d69f9-tg45m\" (UID: \"cfdde838-120c-4ac8-bf81-71893a4b9f21\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.799600 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.799543 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:47.935124 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:47.935094 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m"] Jul 08 18:28:47.936517 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:28:47.936491 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdde838_120c_4ac8_bf81_71893a4b9f21.slice/crio-fc66fdbf7d4942368ddba54cf99c1f1a460732dc85ea91376f1938d266c2ea92 WatchSource:0}: Error finding container fc66fdbf7d4942368ddba54cf99c1f1a460732dc85ea91376f1938d266c2ea92: Status 404 returned error can't find the container with id fc66fdbf7d4942368ddba54cf99c1f1a460732dc85ea91376f1938d266c2ea92 Jul 08 18:28:48.410844 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:48.410804 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" event={"ID":"cfdde838-120c-4ac8-bf81-71893a4b9f21","Type":"ContainerStarted","Data":"fc66fdbf7d4942368ddba54cf99c1f1a460732dc85ea91376f1938d266c2ea92"} Jul 08 18:28:49.422601 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:49.422555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" event={"ID":"cfdde838-120c-4ac8-bf81-71893a4b9f21","Type":"ContainerStarted","Data":"a4bd326d0bbc1867ee2bb576eecad809f7e608870f2f7b538cce20528dbf5f7d"} Jul 08 18:28:49.440895 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:49.440848 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" podStartSLOduration=1.387843215 podStartE2EDuration="2.440831878s" totalImagesPullingTime="1.052988663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:28:49.438973479 +0000 UTC m=+742.181042052" watchObservedRunningTime="2026-07-08 18:28:49.440831878 +0000 UTC m=+742.182900428" Jul 08 18:28:57.800379 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:57.800341 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:57.800781 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:57.800406 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:57.813400 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:57.813354 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:28:58.489122 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:28:58.489093 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-tg45m" Jul 08 18:29:14.790330 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.790291 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj"] Jul 08 18:29:14.793490 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.793470 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.795991 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.795961 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 18:29:14.803958 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.803932 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj"] Jul 08 18:29:14.895017 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.894995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.895121 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.895019 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.895121 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.895053 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.895121 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.895082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.895254 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.895144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqsnl\" (UniqueName: \"kubernetes.io/projected/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-kube-api-access-pqsnl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.895254 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.895185 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.996636 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.996607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.996746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.996655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqsnl\" (UniqueName: \"kubernetes.io/projected/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-kube-api-access-pqsnl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.996746 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.996700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.996860 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.996763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.996860 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.996786 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.996860 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.996839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.997097 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.997071 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.997175 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.997128 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.997333 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.997315 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.998925 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.998905 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:14.999673 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:14.999654 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:15.004622 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:15.004601 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqsnl\" (UniqueName: \"kubernetes.io/projected/c4b4acbf-201e-46d5-a7bb-f58fba57cf1e-kube-api-access-pqsnl\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-ww5lj\" (UID: \"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:15.105136 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:15.105076 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:15.235386 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:15.235356 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj"] Jul 08 18:29:15.235968 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:29:15.235945 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b4acbf_201e_46d5_a7bb_f58fba57cf1e.slice/crio-178dbfb7c0a883a8824bfb59be6d641befe3408420e46cfe96a2bea517da2031 WatchSource:0}: Error finding container 178dbfb7c0a883a8824bfb59be6d641befe3408420e46cfe96a2bea517da2031: Status 404 returned error can't find the container with id 178dbfb7c0a883a8824bfb59be6d641befe3408420e46cfe96a2bea517da2031 Jul 08 18:29:15.576320 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:15.576257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" event={"ID":"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e","Type":"ContainerStarted","Data":"05992c3170052852ce0551789295d614fb5a1e95ba68750de1916719448bf339"} Jul 08 18:29:15.576470 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:15.576363 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" event={"ID":"c4b4acbf-201e-46d5-a7bb-f58fba57cf1e","Type":"ContainerStarted","Data":"178dbfb7c0a883a8824bfb59be6d641befe3408420e46cfe96a2bea517da2031"} Jul 08 18:29:15.594796 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:15.594749 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" podStartSLOduration=1.389586782 podStartE2EDuration="1.594736005s" totalImagesPullingTime="205.149223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:29:15.59163513 +0000 UTC m=+768.333703683" watchObservedRunningTime="2026-07-08 18:29:15.594736005 +0000 UTC m=+768.336804556" Jul 08 18:29:25.105242 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:25.105201 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:25.105892 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:25.105286 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:25.117812 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:25.117790 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:25.645021 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:25.644994 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-ww5lj" Jul 08 18:29:27.690005 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.689969 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4"] Jul 08 18:29:27.693839 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.693816 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.696168 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.696150 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 18:29:27.702470 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.702448 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4"] Jul 08 18:29:27.802980 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.802951 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.803108 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.803003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t76j6\" (UniqueName: \"kubernetes.io/projected/565465c3-1a9f-433f-a301-f1a83b7be709-kube-api-access-t76j6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.803176 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.803152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.803311 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.803285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.803392 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.803340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.803449 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.803397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/565465c3-1a9f-433f-a301-f1a83b7be709-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904217 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904376 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/565465c3-1a9f-433f-a301-f1a83b7be709-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904557 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904557 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904443 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t76j6\" (UniqueName: \"kubernetes.io/projected/565465c3-1a9f-433f-a301-f1a83b7be709-kube-api-access-t76j6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904694 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904749 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904694 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.904800 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.904754 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.906428 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.906394 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/565465c3-1a9f-433f-a301-f1a83b7be709-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.906587 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.906569 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/565465c3-1a9f-433f-a301-f1a83b7be709-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:27.911983 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:27.911960 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t76j6\" (UniqueName: \"kubernetes.io/projected/565465c3-1a9f-433f-a301-f1a83b7be709-kube-api-access-t76j6\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4\" (UID: \"565465c3-1a9f-433f-a301-f1a83b7be709\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:28.004195 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:28.004141 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:28.136911 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:28.136884 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4"] Jul 08 18:29:28.137799 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:29:28.137769 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod565465c3_1a9f_433f_a301_f1a83b7be709.slice/crio-f172f8f20cf3f92636f704a94bf50acf103f0793924918384415851174e2f6a5 WatchSource:0}: Error finding container f172f8f20cf3f92636f704a94bf50acf103f0793924918384415851174e2f6a5: Status 404 returned error can't find the container with id f172f8f20cf3f92636f704a94bf50acf103f0793924918384415851174e2f6a5 Jul 08 18:29:28.660346 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:28.660313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" event={"ID":"565465c3-1a9f-433f-a301-f1a83b7be709","Type":"ContainerStarted","Data":"19f75a4e67f6187afd0f0a5e49d4e9ff04c613b8417056a9720a981891b72fc9"} Jul 08 18:29:28.660498 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:28.660357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" event={"ID":"565465c3-1a9f-433f-a301-f1a83b7be709","Type":"ContainerStarted","Data":"f172f8f20cf3f92636f704a94bf50acf103f0793924918384415851174e2f6a5"} Jul 08 18:29:28.678172 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:28.678130 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" podStartSLOduration=1.492752217 podStartE2EDuration="1.678114986s" totalImagesPullingTime="185.362769ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:29:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:29:28.675298604 +0000 UTC m=+781.417367149" watchObservedRunningTime="2026-07-08 18:29:28.678114986 +0000 UTC m=+781.420183558" Jul 08 18:29:38.004813 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:38.004777 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:38.004813 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:38.004824 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:38.017189 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:38.017167 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:29:38.729291 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:29:38.729251 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4" Jul 08 18:31:36.592963 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:36.592921 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77fdddb666-vph9g"] Jul 08 18:31:36.595705 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:36.593180 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-77fdddb666-vph9g" podUID="4c4e2df0-4d2f-4775-b469-4caaa2a966c4" containerName="manager" containerID="cri-o://034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5" gracePeriod=30 Jul 08 18:31:36.847593 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:36.847543 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:31:36.904011 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:36.903985 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert\") pod \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " Jul 08 18:31:36.904144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:36.904062 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggz4p\" (UniqueName: \"kubernetes.io/projected/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-kube-api-access-ggz4p\") pod \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\" (UID: \"4c4e2df0-4d2f-4775-b469-4caaa2a966c4\") " Jul 08 18:31:36.906064 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:36.906036 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4c4e2df0-4d2f-4775-b469-4caaa2a966c4" (UID: "4c4e2df0-4d2f-4775-b469-4caaa2a966c4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 18:31:36.906173 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:36.906102 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-kube-api-access-ggz4p" (OuterVolumeSpecName: "kube-api-access-ggz4p") pod "4c4e2df0-4d2f-4775-b469-4caaa2a966c4" (UID: "4c4e2df0-4d2f-4775-b469-4caaa2a966c4"). InnerVolumeSpecName "kube-api-access-ggz4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:31:37.004891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.004868 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-webhook-cert\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:31:37.004891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.004890 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggz4p\" (UniqueName: \"kubernetes.io/projected/4c4e2df0-4d2f-4775-b469-4caaa2a966c4-kube-api-access-ggz4p\") on node \"ip-10-0-130-158.ec2.internal\" DevicePath \"\"" Jul 08 18:31:37.396452 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.396419 2558 generic.go:356] "Generic (PLEG): container finished" podID="4c4e2df0-4d2f-4775-b469-4caaa2a966c4" containerID="034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5" exitCode=0 Jul 08 18:31:37.396603 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.396476 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fdddb666-vph9g" Jul 08 18:31:37.396603 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.396506 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fdddb666-vph9g" event={"ID":"4c4e2df0-4d2f-4775-b469-4caaa2a966c4","Type":"ContainerDied","Data":"034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5"} Jul 08 18:31:37.396603 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.396566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fdddb666-vph9g" event={"ID":"4c4e2df0-4d2f-4775-b469-4caaa2a966c4","Type":"ContainerDied","Data":"2aa2ad643d421a985f597b025e2a5f5d3f641577aa081c93a87197d4a4ba2a14"} Jul 08 18:31:37.396603 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.396592 2558 scope.go:117] "RemoveContainer" containerID="034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5" Jul 08 18:31:37.406471 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.406458 2558 scope.go:117] "RemoveContainer" containerID="034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5" Jul 08 18:31:37.406731 ip-10-0-130-158 kubenswrapper[2558]: E0708 18:31:37.406716 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5\": container with ID starting with 034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5 not found: ID does not exist" containerID="034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5" Jul 08 18:31:37.406788 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.406738 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5"} err="failed to get container status \"034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5\": rpc error: code = NotFound desc = could not find container \"034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5\": container with ID starting with 034c9c2499fc725c1e82a84603f56777d6fecdd55ffcea5554a54cfc0301c8a5 not found: ID does not exist" Jul 08 18:31:37.418987 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.418963 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77fdddb666-vph9g"] Jul 08 18:31:37.421818 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.421801 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77fdddb666-vph9g"] Jul 08 18:31:37.730926 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:37.730844 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c4e2df0-4d2f-4775-b469-4caaa2a966c4" path="/var/lib/kubelet/pods/4c4e2df0-4d2f-4775-b469-4caaa2a966c4/volumes" Jul 08 18:31:38.148058 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.148027 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77fdddb666-2r4nn"] Jul 08 18:31:38.148458 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.148443 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c4e2df0-4d2f-4775-b469-4caaa2a966c4" containerName="manager" Jul 08 18:31:38.148458 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.148459 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c4e2df0-4d2f-4775-b469-4caaa2a966c4" containerName="manager" Jul 08 18:31:38.148542 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.148536 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c4e2df0-4d2f-4775-b469-4caaa2a966c4" containerName="manager" Jul 08 18:31:38.152842 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.152824 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.156506 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.156488 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 18:31:38.156635 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.156521 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-scmdl\"" Jul 08 18:31:38.156635 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.156519 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 18:31:38.161668 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.161645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fdddb666-2r4nn"] Jul 08 18:31:38.215035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.215010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vnwg\" (UniqueName: \"kubernetes.io/projected/43a41f03-e8d2-4cf6-8bef-92eed5e79456-kube-api-access-9vnwg\") pod \"maas-controller-77fdddb666-2r4nn\" (UID: \"43a41f03-e8d2-4cf6-8bef-92eed5e79456\") " pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.215159 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.215043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43a41f03-e8d2-4cf6-8bef-92eed5e79456-webhook-cert\") pod \"maas-controller-77fdddb666-2r4nn\" (UID: \"43a41f03-e8d2-4cf6-8bef-92eed5e79456\") " pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.316219 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.316193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vnwg\" (UniqueName: \"kubernetes.io/projected/43a41f03-e8d2-4cf6-8bef-92eed5e79456-kube-api-access-9vnwg\") pod \"maas-controller-77fdddb666-2r4nn\" (UID: \"43a41f03-e8d2-4cf6-8bef-92eed5e79456\") " pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.316353 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.316224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43a41f03-e8d2-4cf6-8bef-92eed5e79456-webhook-cert\") pod \"maas-controller-77fdddb666-2r4nn\" (UID: \"43a41f03-e8d2-4cf6-8bef-92eed5e79456\") " pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.318489 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.318470 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/43a41f03-e8d2-4cf6-8bef-92eed5e79456-webhook-cert\") pod \"maas-controller-77fdddb666-2r4nn\" (UID: \"43a41f03-e8d2-4cf6-8bef-92eed5e79456\") " pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.326872 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.326853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vnwg\" (UniqueName: \"kubernetes.io/projected/43a41f03-e8d2-4cf6-8bef-92eed5e79456-kube-api-access-9vnwg\") pod \"maas-controller-77fdddb666-2r4nn\" (UID: \"43a41f03-e8d2-4cf6-8bef-92eed5e79456\") " pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.465331 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.465262 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:38.598770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:38.598741 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77fdddb666-2r4nn"] Jul 08 18:31:38.600366 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:31:38.600338 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a41f03_e8d2_4cf6_8bef_92eed5e79456.slice/crio-dfede5c0acdd34cf29ec417eae9447f4df9a4fb7d66a9028b0320597571240c7 WatchSource:0}: Error finding container dfede5c0acdd34cf29ec417eae9447f4df9a4fb7d66a9028b0320597571240c7: Status 404 returned error can't find the container with id dfede5c0acdd34cf29ec417eae9447f4df9a4fb7d66a9028b0320597571240c7 Jul 08 18:31:39.409887 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:39.409852 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fdddb666-2r4nn" event={"ID":"43a41f03-e8d2-4cf6-8bef-92eed5e79456","Type":"ContainerStarted","Data":"0a90e73d87a8e134364d42f84a1d5cdd7c156821608bba5b69e4f27390d425b9"} Jul 08 18:31:39.410322 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:39.409946 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:31:39.410322 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:39.409965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77fdddb666-2r4nn" event={"ID":"43a41f03-e8d2-4cf6-8bef-92eed5e79456","Type":"ContainerStarted","Data":"dfede5c0acdd34cf29ec417eae9447f4df9a4fb7d66a9028b0320597571240c7"} Jul 08 18:31:39.429108 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:39.429061 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77fdddb666-2r4nn" podStartSLOduration=0.98641939 podStartE2EDuration="1.429046952s" totalImagesPullingTime="442.627562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:31:39.425992783 +0000 UTC m=+912.168061361" watchObservedRunningTime="2026-07-08 18:31:39.429046952 +0000 UTC m=+912.171115507" Jul 08 18:31:50.422144 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:31:50.422115 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77fdddb666-2r4nn" Jul 08 18:59:08.917351 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:08.917316 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77fdddb666-2r4nn_43a41f03-e8d2-4cf6-8bef-92eed5e79456/manager/0.log" Jul 08 18:59:09.526718 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:09.526685 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-l226n_c016b450-7012-43c8-8b2d-31601f6d4767/copy-manifests/0.log" Jul 08 18:59:09.533462 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:09.533433 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-l226n_c016b450-7012-43c8-8b2d-31601f6d4767/manager/0.log" Jul 08 18:59:10.297649 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.297616 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq_ba678a49-d204-4f9b-9f4e-c636256dd173/util/0.log" Jul 08 18:59:10.304429 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.304402 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq_ba678a49-d204-4f9b-9f4e-c636256dd173/pull/0.log" Jul 08 18:59:10.310867 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.310841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq_ba678a49-d204-4f9b-9f4e-c636256dd173/extract/0.log" Jul 08 18:59:10.431542 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.431503 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq_325b1572-576d-438c-be32-fa97515bce37/pull/0.log" Jul 08 18:59:10.437776 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.437740 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq_325b1572-576d-438c-be32-fa97515bce37/extract/0.log" Jul 08 18:59:10.443929 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.443905 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq_325b1572-576d-438c-be32-fa97515bce37/util/0.log" Jul 08 18:59:10.560238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.560145 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9_8c167a70-4c04-460a-a1ed-1cc988407c91/extract/0.log" Jul 08 18:59:10.566854 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.566835 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9_8c167a70-4c04-460a-a1ed-1cc988407c91/util/0.log" Jul 08 18:59:10.573639 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.573615 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9_8c167a70-4c04-460a-a1ed-1cc988407c91/pull/0.log" Jul 08 18:59:10.691226 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.691194 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5_26b37689-af73-48c4-bab8-dfe80a1112d2/util/0.log" Jul 08 18:59:10.697757 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.697736 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5_26b37689-af73-48c4-bab8-dfe80a1112d2/pull/0.log" Jul 08 18:59:10.704380 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.704356 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5_26b37689-af73-48c4-bab8-dfe80a1112d2/extract/0.log" Jul 08 18:59:10.944342 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:10.944310 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gg6pn_457e2144-f0d1-4c7e-a328-bd433b6fe822/manager/0.log" Jul 08 18:59:11.199669 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:11.199588 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k95jb_24d1d875-cfa9-4418-a7d3-6f9167f6ac9f/kuadrant-console-plugin/0.log" Jul 08 18:59:11.320907 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:11.320873 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-976v7_e713cbac-ccdc-4e33-9e52-1188d0162fc1/registry-server/0.log" Jul 08 18:59:11.702259 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:11.702209 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tckl2_d154ceab-4d84-4725-b2e3-29408c585ac8/manager/0.log" Jul 08 18:59:12.051349 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:12.051245 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9kv9_7461ebed-7877-4f16-81e7-3ff9bb26a376/istio-proxy/0.log" Jul 08 18:59:12.628848 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:12.628813 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx9qd_acdc84a6-6391-4ad4-84e0-a0da5affa0de/payload-pre-processing/0.log" Jul 08 18:59:12.746941 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:12.746908 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9qdwv_5e904bbc-f336-4df5-8412-f1aecb500ed0/payload-processing/0.log" Jul 08 18:59:12.861911 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:12.861875 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c64ff6f99-qbpjr_11f0ca37-6215-4ef3-a483-c03c45e378a7/router/0.log" Jul 08 18:59:13.329820 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:13.329790 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-tg45m_cfdde838-120c-4ac8-bf81-71893a4b9f21/main/0.log" Jul 08 18:59:13.678515 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:13.678486 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-ww5lj_c4b4acbf-201e-46d5-a7bb-f58fba57cf1e/main/0.log" Jul 08 18:59:13.797513 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:13.797469 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-zbws4_565465c3-1a9f-433f-a301-f1a83b7be709/main/0.log" Jul 08 18:59:20.674984 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:20.674951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-czbs4_1157d0fd-f7be-4fea-bfa0-4212d2a77315/global-pull-secret-syncer/0.log" Jul 08 18:59:20.759977 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:20.759943 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-99v7g_4956326e-d875-4102-b4f8-11ad7a3208c4/konnectivity-agent/0.log" Jul 08 18:59:20.818853 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:20.818817 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-158.ec2.internal_831e9ec52a3238957c7f1fb3d14b894f/haproxy/0.log" Jul 08 18:59:25.665134 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.665096 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq_ba678a49-d204-4f9b-9f4e-c636256dd173/extract/0.log" Jul 08 18:59:25.688977 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.688940 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq_ba678a49-d204-4f9b-9f4e-c636256dd173/util/0.log" Jul 08 18:59:25.716049 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.716013 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759m4drq_ba678a49-d204-4f9b-9f4e-c636256dd173/pull/0.log" Jul 08 18:59:25.742538 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.742510 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq_325b1572-576d-438c-be32-fa97515bce37/extract/0.log" Jul 08 18:59:25.763874 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.763841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq_325b1572-576d-438c-be32-fa97515bce37/util/0.log" Jul 08 18:59:25.791188 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.791141 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0hf9rq_325b1572-576d-438c-be32-fa97515bce37/pull/0.log" Jul 08 18:59:25.829797 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.829764 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9_8c167a70-4c04-460a-a1ed-1cc988407c91/extract/0.log" Jul 08 18:59:25.864434 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.864408 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9_8c167a70-4c04-460a-a1ed-1cc988407c91/util/0.log" Jul 08 18:59:25.885980 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.885954 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tzgs9_8c167a70-4c04-460a-a1ed-1cc988407c91/pull/0.log" Jul 08 18:59:25.913980 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.913953 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5_26b37689-af73-48c4-bab8-dfe80a1112d2/extract/0.log" Jul 08 18:59:25.952915 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.952832 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5_26b37689-af73-48c4-bab8-dfe80a1112d2/util/0.log" Jul 08 18:59:25.976685 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:25.976658 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hcnn5_26b37689-af73-48c4-bab8-dfe80a1112d2/pull/0.log" Jul 08 18:59:26.340462 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:26.340374 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gg6pn_457e2144-f0d1-4c7e-a328-bd433b6fe822/manager/0.log" Jul 08 18:59:26.464263 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:26.464236 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-k95jb_24d1d875-cfa9-4418-a7d3-6f9167f6ac9f/kuadrant-console-plugin/0.log" Jul 08 18:59:26.501970 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:26.501922 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-976v7_e713cbac-ccdc-4e33-9e52-1188d0162fc1/registry-server/0.log" Jul 08 18:59:26.665099 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:26.665064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-tckl2_d154ceab-4d84-4725-b2e3-29408c585ac8/manager/0.log" Jul 08 18:59:28.351612 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.351579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a9d787d-da08-4d77-a591-201b25e4d403/alertmanager/0.log" Jul 08 18:59:28.377548 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.377521 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a9d787d-da08-4d77-a591-201b25e4d403/config-reloader/0.log" Jul 08 18:59:28.399473 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.399448 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a9d787d-da08-4d77-a591-201b25e4d403/kube-rbac-proxy-web/0.log" Jul 08 18:59:28.424235 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.424176 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a9d787d-da08-4d77-a591-201b25e4d403/kube-rbac-proxy/0.log" Jul 08 18:59:28.453224 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.453190 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a9d787d-da08-4d77-a591-201b25e4d403/kube-rbac-proxy-metric/0.log" Jul 08 18:59:28.481103 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.481072 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a9d787d-da08-4d77-a591-201b25e4d403/prom-label-proxy/0.log" Jul 08 18:59:28.503316 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.503280 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1a9d787d-da08-4d77-a591-201b25e4d403/init-config-reloader/0.log" Jul 08 18:59:28.576373 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.576331 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-m5dsq_b0040899-243a-4510-ad6e-8708abf3fe8e/kube-state-metrics/0.log" Jul 08 18:59:28.597297 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.597248 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-m5dsq_b0040899-243a-4510-ad6e-8708abf3fe8e/kube-rbac-proxy-main/0.log" Jul 08 18:59:28.623035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.623005 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-m5dsq_b0040899-243a-4510-ad6e-8708abf3fe8e/kube-rbac-proxy-self/0.log" Jul 08 18:59:28.653409 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.653373 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-74867df568-vlntv_706f152f-285e-4b09-8256-6fc9f5902685/metrics-server/0.log" Jul 08 18:59:28.683027 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.683000 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5x7mr_00af267f-eca4-4323-bb0f-968c9b7a42b7/monitoring-plugin/0.log" Jul 08 18:59:28.720035 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.719987 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slt57_fec9a117-9c88-44f4-b525-5c9dd8e41c14/node-exporter/0.log" Jul 08 18:59:28.743205 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.743167 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slt57_fec9a117-9c88-44f4-b525-5c9dd8e41c14/kube-rbac-proxy/0.log" Jul 08 18:59:28.767182 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:28.767159 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-slt57_fec9a117-9c88-44f4-b525-5c9dd8e41c14/init-textfile/0.log" Jul 08 18:59:29.257820 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:29.257759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6wc22_18701abd-89e7-4a75-8e77-832c95319424/prometheus-operator-admission-webhook/0.log" Jul 08 18:59:29.288594 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:29.288563 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-779659f955-qjx6z_79ccc9c3-30e7-489b-aa85-434fa846ecd9/telemeter-client/0.log" Jul 08 18:59:29.310448 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:29.310417 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-779659f955-qjx6z_79ccc9c3-30e7-489b-aa85-434fa846ecd9/reload/0.log" Jul 08 18:59:29.332263 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:29.332232 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-779659f955-qjx6z_79ccc9c3-30e7-489b-aa85-434fa846ecd9/kube-rbac-proxy/0.log" Jul 08 18:59:30.630455 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.630418 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx"] Jul 08 18:59:30.634460 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.634435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.637416 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.637387 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6hq9s\"/\"default-dockercfg-nlchm\"" Jul 08 18:59:30.637589 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.637389 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hq9s\"/\"openshift-service-ca.crt\"" Jul 08 18:59:30.638386 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.638363 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6hq9s\"/\"kube-root-ca.crt\"" Jul 08 18:59:30.642133 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.642106 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx"] Jul 08 18:59:30.644328 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.644304 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-6rr5s_219f2a3f-37f4-4748-8444-f5ecb00bfbe6/networking-console-plugin/0.log" Jul 08 18:59:30.711664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.711623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-proc\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.711664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.711663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhm7t\" (UniqueName: \"kubernetes.io/projected/7e432392-fda7-42c0-948b-83613b2c5f17-kube-api-access-bhm7t\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.711966 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.711761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-sys\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.711966 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.711815 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-lib-modules\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.711966 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.711843 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-podres\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.812999 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.812951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-proc\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.812999 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813000 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhm7t\" (UniqueName: \"kubernetes.io/projected/7e432392-fda7-42c0-948b-83613b2c5f17-kube-api-access-bhm7t\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.813292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-sys\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.813292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-lib-modules\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.813292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-podres\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.813292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813093 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-proc\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.813292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813136 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-sys\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.813292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-lib-modules\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.813292 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.813244 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7e432392-fda7-42c0-948b-83613b2c5f17-podres\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.821873 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.821845 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhm7t\" (UniqueName: \"kubernetes.io/projected/7e432392-fda7-42c0-948b-83613b2c5f17-kube-api-access-bhm7t\") pod \"perf-node-gather-daemonset-s8vjx\" (UID: \"7e432392-fda7-42c0-948b-83613b2c5f17\") " pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:30.947696 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:30.947591 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:31.097407 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:31.097379 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx"] Jul 08 18:59:31.098977 ip-10-0-130-158 kubenswrapper[2558]: W0708 18:59:31.098941 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7e432392_fda7_42c0_948b_83613b2c5f17.slice/crio-15717029771f0b198d4511ad6721a63e52f0caf832308ba79b6c74b0cd65ff66 WatchSource:0}: Error finding container 15717029771f0b198d4511ad6721a63e52f0caf832308ba79b6c74b0cd65ff66: Status 404 returned error can't find the container with id 15717029771f0b198d4511ad6721a63e52f0caf832308ba79b6c74b0cd65ff66 Jul 08 18:59:31.811853 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:31.811817 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-557c9f5c54-qgzxt_adb03876-b86b-4ec9-a283-511964f8e136/console/0.log" Jul 08 18:59:31.843570 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:31.843535 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-58zhj_3a2e2727-d083-4200-ab55-f2dc2bb9db7f/download-server/0.log" Jul 08 18:59:31.940580 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:31.940542 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" event={"ID":"7e432392-fda7-42c0-948b-83613b2c5f17","Type":"ContainerStarted","Data":"50997fe1366eebb0b4490104b9ecfd838af6cb6ccfa8981fe1e5bf94db296bdc"} Jul 08 18:59:31.940770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:31.940601 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:31.940770 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:31.940625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" event={"ID":"7e432392-fda7-42c0-948b-83613b2c5f17","Type":"ContainerStarted","Data":"15717029771f0b198d4511ad6721a63e52f0caf832308ba79b6c74b0cd65ff66"} Jul 08 18:59:31.961404 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:31.961338 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" podStartSLOduration=1.961316052 podStartE2EDuration="1.961316052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:59:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:59:31.958940703 +0000 UTC m=+2584.701009252" watchObservedRunningTime="2026-07-08 18:59:31.961316052 +0000 UTC m=+2584.703384604" Jul 08 18:59:33.556266 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:33.556235 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wds7g_8a1b82f5-714f-41d9-84f0-028fd0eacd6d/dns/0.log" Jul 08 18:59:33.576688 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:33.576655 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wds7g_8a1b82f5-714f-41d9-84f0-028fd0eacd6d/kube-rbac-proxy/0.log" Jul 08 18:59:33.600663 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:33.600630 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mpwj_987f7a45-3051-4fc6-a2d8-a611d88d2f90/dns-node-resolver/0.log" Jul 08 18:59:34.175310 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:34.175257 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-9ccbf56b6-f9sbh_95315e80-2cf8-4d83-abc3-e71bf193c722/registry/0.log" Jul 08 18:59:34.221136 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:34.221101 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ppq4c_a299dc5d-5fb2-4c2b-bd27-5c730b36f679/node-ca/0.log" Jul 08 18:59:35.173896 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:35.173852 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9kv9_7461ebed-7877-4f16-81e7-3ff9bb26a376/istio-proxy/0.log" Jul 08 18:59:35.437891 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:35.437802 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx9qd_acdc84a6-6391-4ad4-84e0-a0da5affa0de/payload-pre-processing/0.log" Jul 08 18:59:35.483887 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:35.483853 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9qdwv_5e904bbc-f336-4df5-8412-f1aecb500ed0/payload-processing/0.log" Jul 08 18:59:35.525705 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:35.525662 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c64ff6f99-qbpjr_11f0ca37-6215-4ef3-a483-c03c45e378a7/router/0.log" Jul 08 18:59:36.164266 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:36.164226 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hns8x_b80889e9-89bc-4dc2-bb97-bfa43ad97565/serve-healthcheck-canary/0.log" Jul 08 18:59:36.666965 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:36.666915 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-4p7p6_9944ec00-1b64-4f4c-be5f-80cec2932efa/insights-operator/0.log" Jul 08 18:59:36.667657 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:36.667635 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-4p7p6_9944ec00-1b64-4f4c-be5f-80cec2932efa/insights-operator/1.log" Jul 08 18:59:36.819589 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:36.819563 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl8hk_cfb15da7-0fa4-4940-8a2b-e7e070caa55a/kube-rbac-proxy/0.log" Jul 08 18:59:36.841051 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:36.841020 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl8hk_cfb15da7-0fa4-4940-8a2b-e7e070caa55a/exporter/0.log" Jul 08 18:59:36.861238 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:36.861202 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wl8hk_cfb15da7-0fa4-4940-8a2b-e7e070caa55a/extractor/0.log" Jul 08 18:59:37.956333 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:37.956303 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6hq9s/perf-node-gather-daemonset-s8vjx" Jul 08 18:59:39.160826 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:39.160779 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77fdddb666-2r4nn_43a41f03-e8d2-4cf6-8bef-92eed5e79456/manager/0.log" Jul 08 18:59:39.401387 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:39.401353 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-l226n_c016b450-7012-43c8-8b2d-31601f6d4767/manager/0.log" Jul 08 18:59:39.425346 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:39.425229 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b9f59cf8-l226n_c016b450-7012-43c8-8b2d-31601f6d4767/copy-manifests/0.log" Jul 08 18:59:40.868745 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:40.868712 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85f5474f9b-qbjgp_0b625172-2743-4c71-98a0-d145c8c198ba/manager/0.log" Jul 08 18:59:41.147664 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:41.147632 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9kv9_7461ebed-7877-4f16-81e7-3ff9bb26a376/istio-proxy/0.log" Jul 08 18:59:41.305857 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:41.305819 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx9qd_acdc84a6-6391-4ad4-84e0-a0da5affa0de/payload-pre-processing/0.log" Jul 08 18:59:41.344315 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:41.344243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9qdwv_5e904bbc-f336-4df5-8412-f1aecb500ed0/payload-processing/0.log" Jul 08 18:59:41.360432 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:41.360398 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c64ff6f99-qbpjr_11f0ca37-6215-4ef3-a483-c03c45e378a7/router/0.log" Jul 08 18:59:42.572169 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:42.572130 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4f9kv9_7461ebed-7877-4f16-81e7-3ff9bb26a376/istio-proxy/0.log" Jul 08 18:59:42.756531 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:42.756437 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qx9qd_acdc84a6-6391-4ad4-84e0-a0da5affa0de/payload-pre-processing/0.log" Jul 08 18:59:42.795988 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:42.795956 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-9qdwv_5e904bbc-f336-4df5-8412-f1aecb500ed0/payload-processing/0.log" Jul 08 18:59:42.808455 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:42.808431 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6c64ff6f99-qbpjr_11f0ca37-6215-4ef3-a483-c03c45e378a7/router/0.log" Jul 08 18:59:47.559661 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:47.559630 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snkk7_10bbd63f-5cbb-4006-a3c7-9255b25420e5/kube-multus-additional-cni-plugins/0.log" Jul 08 18:59:47.580703 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:47.580671 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snkk7_10bbd63f-5cbb-4006-a3c7-9255b25420e5/egress-router-binary-copy/0.log" Jul 08 18:59:47.605479 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:47.605450 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snkk7_10bbd63f-5cbb-4006-a3c7-9255b25420e5/cni-plugins/0.log" Jul 08 18:59:47.632833 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:47.632798 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snkk7_10bbd63f-5cbb-4006-a3c7-9255b25420e5/bond-cni-plugin/0.log" Jul 08 18:59:47.654355 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:47.654327 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snkk7_10bbd63f-5cbb-4006-a3c7-9255b25420e5/routeoverride-cni/0.log" Jul 08 18:59:47.678300 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:47.678244 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snkk7_10bbd63f-5cbb-4006-a3c7-9255b25420e5/whereabouts-cni-bincopy/0.log" Jul 08 18:59:47.701753 ip-10-0-130-158 kubenswrapper[2558]: I0708 18:59:47.701717 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-snkk7_10bbd63f-5cbb-4006-a3c7-9255b25420e5/whereabouts-cni/0.log"