Jul 06 19:48:08.453949 ip-10-0-135-185 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 19:48:08.453959 ip-10-0-135-185 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 19:48:08.453967 ip-10-0-135-185 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 19:48:08.454171 ip-10-0-135-185 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 19:48:18.646492 ip-10-0-135-185 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 19:48:18.646512 ip-10-0-135-185 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3f31ca09ebdb4705b2590b50a2fa1924 -- Jul 06 19:50:16.608925 ip-10-0-135-185 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.020202 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023618 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023629 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023633 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023651 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023654 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023657 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023660 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023663 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:50:17.108560 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023666 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:50:17.088706 ip-10-0-135-185 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023670 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023673 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023675 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023678 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023680 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023683 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023686 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023689 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023697 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023700 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023702 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023705 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023708 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023710 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023713 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023715 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023718 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023721 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:50:17.113421 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023723 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023726 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023729 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023732 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023735 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023738 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023741 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023743 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023745 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023748 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023751 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023753 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023755 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023758 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023760 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023763 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023765 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023767 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023772 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023775 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:50:17.114097 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023778 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023780 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023785 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023788 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023790 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023793 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023797 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023800 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023802 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023805 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023807 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023811 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023813 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023816 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023818 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023820 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023823 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023826 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023828 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:50:17.114874 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023831 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023833 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023836 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023839 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023841 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023844 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023847 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023849 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023852 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023854 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023857 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023861 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023864 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023867 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023870 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023872 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023875 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023877 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023881 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023884 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:50:17.115625 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023886 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023889 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023891 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023894 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023897 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023899 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023902 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023904 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023907 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023911 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023914 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023916 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.023919 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024602 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024609 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024613 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024615 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024618 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024621 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024624 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:50:17.116754 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024627 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024630 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024633 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024647 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024650 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024653 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024656 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024658 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024661 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024664 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024667 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024669 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024672 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024674 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024677 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024679 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024682 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024684 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024687 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024689 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:50:17.121424 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024692 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024695 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024698 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024700 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024703 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024706 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024709 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024711 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024714 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024717 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024722 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024725 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024728 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024731 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024734 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024737 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024740 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024743 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024745 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:50:17.122102 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024749 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024751 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024754 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024760 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024763 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024766 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024769 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024772 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024774 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024776 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024779 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024782 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024785 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024788 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024792 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024796 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024824 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024828 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024831 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:50:17.122750 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024834 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024837 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024840 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024843 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024846 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024848 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024851 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024854 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024858 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024862 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024866 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024869 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024871 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024874 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024877 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024879 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024882 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024885 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024888 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024891 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:50:17.123480 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024893 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024896 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024899 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024901 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024904 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024906 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024909 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024911 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024915 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024918 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024920 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024923 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024925 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.024928 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025289 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025295 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025299 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025302 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025305 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025308 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:50:17.124248 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025311 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025314 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025316 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025319 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025321 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025324 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025327 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025330 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025334 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025337 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025340 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025343 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025346 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025348 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025351 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025354 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025356 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025358 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025361 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025363 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:50:17.124904 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025368 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025370 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025373 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025376 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025378 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025380 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025383 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025386 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025389 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025391 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025394 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025397 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025400 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025402 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025405 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025407 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025410 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025412 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025415 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025417 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:50:17.318606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025422 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025424 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025427 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025430 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025432 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025435 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025438 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025441 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025443 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025446 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025448 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025451 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025455 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025457 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025460 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025462 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025464 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025467 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025470 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025472 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:50:17.333568 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025474 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025477 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025480 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025482 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025484 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025487 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025490 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025492 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025495 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025497 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025500 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025504 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025509 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025512 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025515 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025518 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025521 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025523 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025526 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025529 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:50:17.335273 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025531 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025534 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025536 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025539 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025543 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025546 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025550 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025553 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025556 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025558 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025561 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025564 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.025567 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025632 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025662 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025671 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025676 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025680 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025683 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025687 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:50:17.336100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025691 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025694 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025697 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025700 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025705 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025709 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025712 2558 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025714 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025718 2558 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025721 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025724 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025728 2558 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025731 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025734 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025737 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025740 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025746 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025749 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025752 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025755 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025758 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025761 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025764 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025767 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:50:17.337658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025770 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025774 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025777 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025780 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025783 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025785 2558 flags.go:64] FLAG: --enable-server="true" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025789 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025797 2558 flags.go:64] FLAG: --event-burst="100" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025801 2558 flags.go:64] FLAG: --event-qps="50" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025803 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025806 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025814 2558 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025823 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025826 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025829 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025832 2558 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025835 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025838 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025841 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025844 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025847 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025849 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025852 2558 flags.go:64] FLAG: --feature-gates="" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025856 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025860 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:50:17.338374 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025863 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025866 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025869 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025872 2558 flags.go:64] FLAG: --help="false" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025875 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025878 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025881 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025883 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025887 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025890 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025893 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025895 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025898 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025901 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025904 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025907 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025909 2558 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025912 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025915 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025919 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025922 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025925 2558 flags.go:64] FLAG: --lock-file="" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025927 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025930 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:50:17.339104 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025933 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025943 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025946 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025949 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025952 2558 flags.go:64] FLAG: --logging-format="text" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025955 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025958 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025962 2558 flags.go:64] FLAG: --manifest-url="" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025965 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025969 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025972 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025976 2558 flags.go:64] FLAG: --max-pods="110" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025979 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025982 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025985 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025988 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025991 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025994 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.025997 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026003 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026006 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026009 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026012 2558 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:50:17.339849 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026015 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026021 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026024 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026027 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026031 2558 flags.go:64] FLAG: --port="10250" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026034 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026037 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ab12464328699b52" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026040 2558 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026043 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026046 2558 flags.go:64] FLAG: --register-node="true" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026049 2558 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026053 2558 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026056 2558 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026059 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026062 2558 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026066 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026068 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026073 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026076 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026079 2558 flags.go:64] FLAG: --runonce="false" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026081 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026084 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026087 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026090 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026093 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026096 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:50:17.340495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026098 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026101 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026105 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026107 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026110 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026113 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026116 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026118 2558 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026121 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026126 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026130 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026133 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026137 2558 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026140 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026142 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026145 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026148 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026151 2558 flags.go:64] FLAG: --v="2" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026155 2558 flags.go:64] FLAG: --version="false" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026159 2558 flags.go:64] FLAG: --vmodule="" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026162 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.026165 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026278 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026283 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:50:17.341311 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026286 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026289 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026292 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026294 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026297 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026299 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026302 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026305 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026307 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026310 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026312 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026315 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026317 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026320 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026322 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026325 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026327 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026330 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026334 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:50:17.342012 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026338 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026342 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026345 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026348 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026351 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026353 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026356 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026359 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026363 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026365 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026367 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026370 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026375 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026377 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026380 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026382 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026385 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026387 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026390 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026392 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:50:17.342617 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026395 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026397 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026400 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026403 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026405 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026408 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026411 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026413 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026416 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026418 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026421 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026425 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026427 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026430 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026432 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026435 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026437 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026440 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026442 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026445 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:50:17.343213 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026447 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026450 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026453 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026455 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026459 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026461 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026464 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026468 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026471 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026474 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026476 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026479 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026482 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026485 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026488 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026491 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026493 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026496 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026499 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:50:17.343837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026502 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026505 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026507 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026510 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026515 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026519 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026522 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026525 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026528 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026530 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026533 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026535 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026538 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026541 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026543 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026546 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026548 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026552 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:50:17.344418 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.026555 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.027133 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.034692 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.034706 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.035494 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.035501 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035555 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035559 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035563 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035566 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035569 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035572 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035575 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035578 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035581 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:50:17.344978 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035584 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035587 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035589 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035595 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035597 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035600 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035603 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035611 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035614 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035617 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035620 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035623 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035625 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035628 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035631 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035646 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035649 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035653 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035655 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035658 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:50:17.345532 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035661 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035663 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035666 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035669 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035671 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035674 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035677 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035679 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035682 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035684 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035687 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035690 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035692 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035695 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035697 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035701 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035704 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035707 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035710 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035712 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:50:17.346160 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035715 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035717 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035720 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035723 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035725 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035728 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035730 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035733 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035736 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035740 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035743 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035745 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035748 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035751 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035754 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035756 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035759 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035761 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035764 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035768 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:50:17.346869 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035772 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035775 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035777 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035780 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035784 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035787 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035790 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035794 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035797 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035799 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035803 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035805 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035808 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035810 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035813 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035815 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035819 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035823 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035825 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:50:17.347463 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035828 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035831 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035836 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035839 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035841 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035844 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035846 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035849 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035852 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035854 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035857 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.035862 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035977 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035983 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035986 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:50:17.348096 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035989 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035992 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035995 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.035998 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036001 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036005 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036007 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036010 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036013 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036016 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036019 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036022 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036024 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036027 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036030 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036032 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036035 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036037 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036040 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036042 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:50:17.519436 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036046 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036049 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036051 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036054 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036057 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036060 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036062 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036065 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036067 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036070 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036072 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036075 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036077 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036079 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036082 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036084 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036087 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036090 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036093 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:50:17.520641 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036095 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036098 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036100 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036103 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036106 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036108 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036111 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036113 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036116 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036118 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036121 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036123 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036127 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036132 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036134 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036137 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036140 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036144 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036147 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:50:17.521338 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036150 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036153 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036156 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036159 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036162 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036165 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036168 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036170 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036173 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036175 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036178 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036182 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036185 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036187 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036190 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036192 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036195 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036202 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036205 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:50:17.521920 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036207 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036210 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036212 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036215 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036218 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036221 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036224 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036228 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036231 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036234 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036236 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036239 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036241 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036244 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036246 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036249 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036252 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036254 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:50:17.522606 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:17.036257 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.036262 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.036360 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.038264 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.040009 2558 server.go:1019] "Starting client certificate rotation" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.040107 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.040143 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.042279 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.043423 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.056376 2558 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.058771 2558 log.go:25] "Validated CRI v1 image API" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.059496 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:50:17.523168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.061891 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aed4cb7d-b60f-4d61-b94b-2d1a5a6f2b59:/dev/nvme0n1p3 dfe0fa04-054b-4252-886e-a4177eced987:/dev/nvme0n1p4] Jul 06 19:50:17.523555 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.061906 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:50:17.523555 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.068158 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.068989 2558 manager.go:216] Machine: {Timestamp:2026-07-06 19:50:17.067576121 +0000 UTC m=+0.338330412 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201111 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22e4cde445272e69e102493d328804 SystemUUID:ec22e4cd-e445-272e-69e1-02493d328804 BootID:3f31ca09-ebdb-4705-b259-0b50a2fa1924 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:1f:f7:94:6f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:1f:f7:94:6f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:a4:07:83:89:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.069125 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.069224 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.072471 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.072499 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-185.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.073243 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.073253 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.073260 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.073819 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.075094 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078048 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078152 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078178 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078192 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078201 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078211 2558 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078219 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:50:17.523822 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078550 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.078569 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.081383 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.083174 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.083200 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084202 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084214 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084220 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084225 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084233 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084238 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084246 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084251 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084256 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084262 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084276 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.084282 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.085032 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.085041 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.088033 2558 server.go:1268] "Started kubelet" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.088400 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.088607 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.088793 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.089183 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-185.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.089210 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-185.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.089245 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.090436 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.090499 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.094315 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.095690 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.095697 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.095802 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.096608 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.096621 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.096610 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.096719 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.096726 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097169 2558 factory.go:55] Registering systemd factory Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097201 2558 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.095378 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-185.ec2.internal.18bfcb3797897abf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-185.ec2.internal,UID:ip-10-0-135-185.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-185.ec2.internal,},FirstTimestamp:2026-07-06 19:50:17.088015039 +0000 UTC m=+0.358769330,LastTimestamp:2026-07-06 19:50:17.088015039 +0000 UTC m=+0.358769330,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-185.ec2.internal,}" Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097407 2558 factory.go:153] Registering CRI-O factory Jul 06 19:50:17.524397 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097422 2558 factory.go:223] Registration of the crio container factory successfully Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097461 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097479 2558 factory.go:103] Registering Raw factory Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097495 2558 manager.go:1196] Started watching for new ooms in manager Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.097871 2558 manager.go:349] Starting recovery of all containers Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.109244 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.109345 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-185.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.109968 2558 manager.go:354] Recovery completed Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.114128 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.116058 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.116085 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.116097 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117249 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117259 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117261 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117272 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117590 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t94nc" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117951 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117976 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.117988 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.118527 2558 policy_none.go:49] "None policy: Start" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.118538 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.118548 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.119528 2558 policy_none.go:47] "Start" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.123190 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t94nc" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.146253 2558 manager.go:337] "Starting Device Plugin manager" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.146290 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.146306 2558 server.go:87] "Starting device plugin registration server" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.146558 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.146570 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.146670 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.146748 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.146756 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.151885 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.151923 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.247483 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.248631 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.248683 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.248697 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.248724 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.258480 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.258502 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-185.ec2.internal\": node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.287708 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.312314 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.313612 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:50:17.525604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.313660 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.313686 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.313741 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.321026 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.388283 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.414682 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal"] Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.414761 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.416536 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.416566 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.416577 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.417879 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.417991 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.418021 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.418589 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.418607 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.418592 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.418633 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.418617 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.418662 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.424575 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.424607 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.425299 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.425318 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.425328 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.440850 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-185.ec2.internal\" not found" node="ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.443360 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-185.ec2.internal\" not found" node="ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.488962 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.498961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/212c55d9504a9d4829be9a08210315e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal\" (UID: \"212c55d9504a9d4829be9a08210315e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.498999 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/212c55d9504a9d4829be9a08210315e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal\" (UID: \"212c55d9504a9d4829be9a08210315e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.526855 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.499028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8599849733ad70aaa09ca90f957a879d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-185.ec2.internal\" (UID: \"8599849733ad70aaa09ca90f957a879d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.677998 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.589877 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.677998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.599834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/212c55d9504a9d4829be9a08210315e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal\" (UID: \"212c55d9504a9d4829be9a08210315e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.677998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.599874 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/212c55d9504a9d4829be9a08210315e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal\" (UID: \"212c55d9504a9d4829be9a08210315e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.677998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.599895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8599849733ad70aaa09ca90f957a879d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-185.ec2.internal\" (UID: \"8599849733ad70aaa09ca90f957a879d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.677998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.599926 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/212c55d9504a9d4829be9a08210315e9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal\" (UID: \"212c55d9504a9d4829be9a08210315e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.677998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.599944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8599849733ad70aaa09ca90f957a879d-config\") pod \"kube-apiserver-proxy-ip-10-0-135-185.ec2.internal\" (UID: \"8599849733ad70aaa09ca90f957a879d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.677998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.599947 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/212c55d9504a9d4829be9a08210315e9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal\" (UID: \"212c55d9504a9d4829be9a08210315e9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.822601 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.692908 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:17.822601 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.746510 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.822601 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:17.753064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" Jul 06 19:50:17.822601 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.793846 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:18.001933 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:17.900460 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:18.001933 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:18.001030 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:18.129591 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.040497 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:50:18.129591 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.040705 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:50:18.129591 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:18.101692 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-185.ec2.internal\" not found" Jul 06 19:50:18.129591 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.125098 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:45:17 +0000 UTC" deadline="2028-03-13 19:05:27.478442232 +0000 UTC" Jul 06 19:50:18.129591 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.125125 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14783h15m9.3533221s" Jul 06 19:50:18.318800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.188257 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:50:18.318800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.196425 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" Jul 06 19:50:18.318800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.217530 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:50:18.318800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.219355 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" Jul 06 19:50:18.318800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.234769 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:50:18.318800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.259167 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:50:18.629059 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:18.511092 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212c55d9504a9d4829be9a08210315e9.slice/crio-c033be92d7c9e436c98d7ba4d2a589e7b96fbaab264f55ba6b56be9c1357a69b WatchSource:0}: Error finding container c033be92d7c9e436c98d7ba4d2a589e7b96fbaab264f55ba6b56be9c1357a69b: Status 404 returned error can't find the container with id c033be92d7c9e436c98d7ba4d2a589e7b96fbaab264f55ba6b56be9c1357a69b Jul 06 19:50:18.629059 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:18.511398 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8599849733ad70aaa09ca90f957a879d.slice/crio-3fa12d761c15e518b723d6bf5bedeee2e3cd0c546e08f379c90a36da89c42241 WatchSource:0}: Error finding container 3fa12d761c15e518b723d6bf5bedeee2e3cd0c546e08f379c90a36da89c42241: Status 404 returned error can't find the container with id 3fa12d761c15e518b723d6bf5bedeee2e3cd0c546e08f379c90a36da89c42241 Jul 06 19:50:18.629059 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.514887 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:50:18.629059 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:18.565423 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:50:19.081143 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.081046 2558 apiserver.go:52] "Watching apiserver" Jul 06 19:50:19.090088 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.090061 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:50:19.090457 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.090430 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-5468s","openshift-multus/network-metrics-daemon-jkhqs","openshift-network-operator/iptables-alerter-xvgvs","kube-system/konnectivity-agent-zq4sk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf","openshift-dns/node-resolver-rzcpb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal","openshift-multus/multus-7vm2d","openshift-multus/multus-additional-cni-plugins-gjpdf","openshift-network-diagnostics/network-check-target-vf2qs","openshift-ovn-kubernetes/ovnkube-node-r9rd9","kube-system/global-pull-secret-syncer-vjlns","kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9jqsr"] Jul 06 19:50:19.092725 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.092702 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.093866 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.093849 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:19.093952 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.093913 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:19.094974 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.094955 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.095097 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.095079 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:50:19.095170 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.095149 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rsgdq\"" Jul 06 19:50:19.095225 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.095183 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:50:19.095414 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.095400 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:50:19.096254 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.096241 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.097276 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.097239 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:50:19.097481 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.097461 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:50:19.097585 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.097573 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:50:19.097642 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.097595 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:50:19.097713 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.097677 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rz4d8\"" Jul 06 19:50:19.097953 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.097930 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.099410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.099172 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.099410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.099212 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ptgp5\"" Jul 06 19:50:19.099410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.099264 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:50:19.099410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.099217 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:50:19.100269 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.100249 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-krnc9\"" Jul 06 19:50:19.100353 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.100273 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:50:19.100413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.100358 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:50:19.100754 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.100734 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:50:19.100839 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.100808 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.101539 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.101525 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:50:19.101599 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.101578 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jhwpc\"" Jul 06 19:50:19.101658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.101578 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:50:19.102060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.102047 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.103243 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.103227 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:19.103323 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.103292 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:19.103805 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.103783 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:50:19.103937 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.103811 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:50:19.103937 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.103782 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:50:19.103937 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.103894 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:50:19.104106 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.103984 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sl768\"" Jul 06 19:50:19.104319 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.104304 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:50:19.104940 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.104922 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nqg2x\"" Jul 06 19:50:19.105047 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.104968 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.105444 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.105424 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:50:19.107581 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.107664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-sys-fs\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.107664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107632 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rfhd\" (UniqueName: \"kubernetes.io/projected/85cc9abf-fbb9-43b0-a515-5380818c06b2-kube-api-access-9rfhd\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.107759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz9g9\" (UniqueName: \"kubernetes.io/projected/0728ac1f-e602-41f4-8133-77a0fb7696a7-kube-api-access-jz9g9\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:19.107759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107698 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.107824 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ade938-bfc4-413e-a75b-60e8c08c3c68-host\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.107870 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:19.107924 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89498a8d-48b3-45f7-a044-30aeecd7bac9-iptables-alerter-script\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.107978 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107929 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89498a8d-48b3-45f7-a044-30aeecd7bac9-host-slash\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.107978 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.107964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0496c38-ac84-477d-b564-24abc184e8a7-agent-certs\") pod \"konnectivity-agent-zq4sk\" (UID: \"d0496c38-ac84-477d-b564-24abc184e8a7\") " pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.108074 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89ade938-bfc4-413e-a75b-60e8c08c3c68-serviceca\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.108126 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqdb4\" (UniqueName: \"kubernetes.io/projected/89ade938-bfc4-413e-a75b-60e8c08c3c68-kube-api-access-wqdb4\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.108178 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-socket-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.108232 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108205 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-registration-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.108279 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-device-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.108327 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108308 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v572\" (UniqueName: \"kubernetes.io/projected/89498a8d-48b3-45f7-a044-30aeecd7bac9-kube-api-access-9v572\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.108376 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108341 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0496c38-ac84-477d-b564-24abc184e8a7-konnectivity-ca\") pod \"konnectivity-agent-zq4sk\" (UID: \"d0496c38-ac84-477d-b564-24abc184e8a7\") " pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.108843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.108821 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.109193 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.109164 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:19.109302 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109252 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:50:19.109760 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109350 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:50:19.109760 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109261 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:50:19.109760 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109429 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h7hgp\"" Jul 06 19:50:19.109760 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109449 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:50:19.109760 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109518 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:50:19.109760 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109620 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:50:19.110009 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.109807 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:50:19.110781 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.110763 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.113024 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.113003 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:50:19.113102 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.113049 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:50:19.113102 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.113080 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qscs7\"" Jul 06 19:50:19.185206 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.185178 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j2jq2" Jul 06 19:50:19.191998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.191969 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j2jq2" Jul 06 19:50:19.198545 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.198480 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:50:19.208771 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.208742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-systemd-units\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.208893 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.208784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.208893 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.208815 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-cni-binary-copy\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.208893 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.208860 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q424\" (UniqueName: \"kubernetes.io/projected/a795b245-ceba-469b-b542-be1f1c8d074f-kube-api-access-9q424\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.209049 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.208891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-kubelet\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209049 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.208918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-var-lib-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209049 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.208981 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-ovn\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209049 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209015 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8716a40a-a752-453a-88e0-c096ed8ee208-dbus\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.209183 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.209183 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-run\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.209183 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-tuned\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.209183 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-systemd\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209183 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209183 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.209368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-modprobe-d\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.209368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d9219de-0325-43e7-8d2c-03c225d71885-ovn-node-metrics-cert\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-cnibin\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.209368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209286 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k88zb\" (UniqueName: \"kubernetes.io/projected/005f5b5c-aac6-49fa-b472-c45f523b7846-kube-api-access-k88zb\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.209368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysctl-d\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.209368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ade938-bfc4-413e-a75b-60e8c08c3c68-host\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.209703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0496c38-ac84-477d-b564-24abc184e8a7-agent-certs\") pod \"konnectivity-agent-zq4sk\" (UID: \"d0496c38-ac84-477d-b564-24abc184e8a7\") " pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.209703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-slash\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/89ade938-bfc4-413e-a75b-60e8c08c3c68-host\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.209703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209520 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-ovnkube-script-lib\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xdzv\" (UniqueName: \"kubernetes.io/projected/7d9219de-0325-43e7-8d2c-03c225d71885-kube-api-access-5xdzv\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.209703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-sys\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.209703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqdb4\" (UniqueName: \"kubernetes.io/projected/89ade938-bfc4-413e-a75b-60e8c08c3c68-kube-api-access-wqdb4\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.209956 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209814 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:50:19.209956 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209842 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-registration-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.209956 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-os-release\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.209956 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.209956 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209926 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.209956 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0496c38-ac84-477d-b564-24abc184e8a7-konnectivity-ca\") pod \"konnectivity-agent-zq4sk\" (UID: \"d0496c38-ac84-477d-b564-24abc184e8a7\") " pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.210212 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.209992 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-etc-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.210212 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210006 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-registration-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.210212 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210032 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-env-overrides\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.210212 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.210212 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210145 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz9g9\" (UniqueName: \"kubernetes.io/projected/0728ac1f-e602-41f4-8133-77a0fb7696a7-kube-api-access-jz9g9\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:19.210212 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-node-log\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.210212 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210201 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-cni-bin\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-ovnkube-config\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210330 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysconfig\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210356 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-kubernetes\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210421 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysctl-conf\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89498a8d-48b3-45f7-a044-30aeecd7bac9-iptables-alerter-script\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a795b245-ceba-469b-b542-be1f1c8d074f-hosts-file\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-conf-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210526 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d0496c38-ac84-477d-b564-24abc184e8a7-konnectivity-ca\") pod \"konnectivity-agent-zq4sk\" (UID: \"d0496c38-ac84-477d-b564-24abc184e8a7\") " pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.210549 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtn8\" (UniqueName: \"kubernetes.io/projected/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-kube-api-access-tjtn8\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.210928 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-cnibin\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.210928 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210642 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.211028 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.210929 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.211028 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-lib-modules\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.211130 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211079 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-var-lib-kubelet\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.211130 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89498a8d-48b3-45f7-a044-30aeecd7bac9-iptables-alerter-script\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.211130 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89ade938-bfc4-413e-a75b-60e8c08c3c68-serviceca\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.211265 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-socket-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.211265 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-device-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.211265 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-run-netns\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.211265 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-netns\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-os-release\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-socket-dir-parent\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-kubelet\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-hostroot\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211389 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-daemon-config\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-sys-fs\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211476 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-device-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211504 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-cni-netd\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8716a40a-a752-453a-88e0-c096ed8ee208-kubelet-config\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-cni-bin\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211577 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-socket-dir\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211590 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-cni-multus\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.211658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211615 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-multus-certs\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211671 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-systemd\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211677 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-sys-fs\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211756 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89498a8d-48b3-45f7-a044-30aeecd7bac9-host-slash\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/85cc9abf-fbb9-43b0-a515-5380818c06b2-etc-selinux\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211832 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a795b245-ceba-469b-b542-be1f1c8d074f-tmp-dir\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-host\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-system-cni-dir\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211887 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89498a8d-48b3-45f7-a044-30aeecd7bac9-host-slash\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v572\" (UniqueName: \"kubernetes.io/projected/89498a8d-48b3-45f7-a044-30aeecd7bac9-kube-api-access-9v572\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:19.212016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.211986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-log-socket\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212039 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212090 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/89ade938-bfc4-413e-a75b-60e8c08c3c68-serviceca\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212097 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-system-cni-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-cni-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212152 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-k8s-cni-cncf-io\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212178 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-etc-kubernetes\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212208 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rfhd\" (UniqueName: \"kubernetes.io/projected/85cc9abf-fbb9-43b0-a515-5380818c06b2-kube-api-access-9rfhd\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab8700a8-83c5-4701-b4da-18c46816b7d6-tmp\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212421 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7vsx\" (UniqueName: \"kubernetes.io/projected/ab8700a8-83c5-4701-b4da-18c46816b7d6-kube-api-access-q7vsx\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.212528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.212452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:19.213050 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.212563 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:19.213050 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.212671 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:19.712605549 +0000 UTC m=+2.983359843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:19.215974 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.215912 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d0496c38-ac84-477d-b564-24abc184e8a7-agent-certs\") pod \"konnectivity-agent-zq4sk\" (UID: \"d0496c38-ac84-477d-b564-24abc184e8a7\") " pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.222727 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.222681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqdb4\" (UniqueName: \"kubernetes.io/projected/89ade938-bfc4-413e-a75b-60e8c08c3c68-kube-api-access-wqdb4\") pod \"node-ca-5468s\" (UID: \"89ade938-bfc4-413e-a75b-60e8c08c3c68\") " pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.224032 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.224009 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz9g9\" (UniqueName: \"kubernetes.io/projected/0728ac1f-e602-41f4-8133-77a0fb7696a7-kube-api-access-jz9g9\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:19.224208 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.224190 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rfhd\" (UniqueName: \"kubernetes.io/projected/85cc9abf-fbb9-43b0-a515-5380818c06b2-kube-api-access-9rfhd\") pod \"aws-ebs-csi-driver-node-dtfkf\" (UID: \"85cc9abf-fbb9-43b0-a515-5380818c06b2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.224359 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.224313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v572\" (UniqueName: \"kubernetes.io/projected/89498a8d-48b3-45f7-a044-30aeecd7bac9-kube-api-access-9v572\") pod \"iptables-alerter-xvgvs\" (UID: \"89498a8d-48b3-45f7-a044-30aeecd7bac9\") " pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.313247 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313210 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-system-cni-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313247 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-cni-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-k8s-cni-cncf-io\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-etc-kubernetes\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313322 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab8700a8-83c5-4701-b4da-18c46816b7d6-tmp\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7vsx\" (UniqueName: \"kubernetes.io/projected/ab8700a8-83c5-4701-b4da-18c46816b7d6-kube-api-access-q7vsx\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-k8s-cni-cncf-io\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-systemd-units\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313407 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313453 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313478 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-system-cni-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313525 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-cni-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313539 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-cni-binary-copy\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q424\" (UniqueName: \"kubernetes.io/projected/a795b245-ceba-469b-b542-be1f1c8d074f-kube-api-access-9q424\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-kubelet\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313642 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-var-lib-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-ovn\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8716a40a-a752-453a-88e0-c096ed8ee208-dbus\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-run\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-systemd-units\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-tuned\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-systemd\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313822 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-ovn\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313828 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-etc-kubernetes\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313884 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313927 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-modprobe-d\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.313971 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d9219de-0325-43e7-8d2c-03c225d71885-ovn-node-metrics-cert\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313985 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-cnibin\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.313996 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-kubelet\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314011 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k88zb\" (UniqueName: \"kubernetes.io/projected/005f5b5c-aac6-49fa-b472-c45f523b7846-kube-api-access-k88zb\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314049 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysctl-d\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-var-lib-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-slash\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314104 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-ovnkube-script-lib\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xdzv\" (UniqueName: \"kubernetes.io/projected/7d9219de-0325-43e7-8d2c-03c225d71885-kube-api-access-5xdzv\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314160 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-sys\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314169 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-modprobe-d\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-os-release\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314215 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-cni-binary-copy\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314218 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-sys\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314267 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314296 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-cnibin\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.314904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314315 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysctl-d\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314328 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-etc-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-slash\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314357 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-env-overrides\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314398 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-node-log\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-cni-bin\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-ovnkube-config\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysconfig\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-kubernetes\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314525 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysctl-conf\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314553 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a795b245-ceba-469b-b542-be1f1c8d074f-hosts-file\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-conf-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtn8\" (UniqueName: \"kubernetes.io/projected/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-kube-api-access-tjtn8\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-cnibin\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-lib-modules\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-var-lib-kubelet\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.315744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314781 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-run-netns\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314808 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-netns\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314820 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-env-overrides\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-os-release\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-socket-dir-parent\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-os-release\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-kubelet\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314942 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-kubelet\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-hostroot\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.314974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-daemon-config\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-cni-netd\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315032 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8716a40a-a752-453a-88e0-c096ed8ee208-kubelet-config\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315059 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-cni-bin\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315084 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-cni-multus\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315110 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-multus-certs\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315140 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-systemd\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a795b245-ceba-469b-b542-be1f1c8d074f-tmp-dir\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-host\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.316574 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-system-cni-dir\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315281 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-log-socket\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315412 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315426 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-os-release\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315643 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.315936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-ovnkube-script-lib\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316115 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-etc-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316222 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-cni-bin\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316293 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-socket-dir-parent\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316331 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-node-log\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.316407 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.316478 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret podName:8716a40a-a752-453a-88e0-c096ed8ee208 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:19.816459554 +0000 UTC m=+3.087213837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret") pod "global-pull-secret-syncer-vjlns" (UID: "8716a40a-a752-453a-88e0-c096ed8ee208") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316525 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7d9219de-0325-43e7-8d2c-03c225d71885-ovnkube-config\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.317466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316586 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysconfig\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316618 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-kubernetes\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316698 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8716a40a-a752-453a-88e0-c096ed8ee208-dbus\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316702 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-sysctl-conf\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a795b245-ceba-469b-b542-be1f1c8d074f-hosts-file\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316792 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-systemd\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-conf-dir\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316796 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-run\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-run-openvswitch\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316855 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8716a40a-a752-453a-88e0-c096ed8ee208-kubelet-config\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316856 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-cnibin\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-cni-netd\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-var-lib-kubelet\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316989 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-multus-certs\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316996 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-host-run-netns\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-cni-multus\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317037 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-run-netns\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317080 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-hostroot\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.318272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317330 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/005f5b5c-aac6-49fa-b472-c45f523b7846-cni-binary-copy\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7d9219de-0325-43e7-8d2c-03c225d71885-ovn-node-metrics-cert\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317334 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a795b245-ceba-469b-b542-be1f1c8d074f-tmp-dir\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7d9219de-0325-43e7-8d2c-03c225d71885-log-socket\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317408 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-systemd\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.316946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-host-var-lib-cni-bin\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-host\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317475 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/005f5b5c-aac6-49fa-b472-c45f523b7846-system-cni-dir\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317496 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ab8700a8-83c5-4701-b4da-18c46816b7d6-lib-modules\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317541 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab8700a8-83c5-4701-b4da-18c46816b7d6-tmp\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.319164 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.317588 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-multus-daemon-config\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.319630 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.319261 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ab8700a8-83c5-4701-b4da-18c46816b7d6-etc-tuned\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.321159 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.321103 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" event={"ID":"212c55d9504a9d4829be9a08210315e9","Type":"ContainerStarted","Data":"c033be92d7c9e436c98d7ba4d2a589e7b96fbaab264f55ba6b56be9c1357a69b"} Jul 06 19:50:19.322523 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.322495 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" event={"ID":"8599849733ad70aaa09ca90f957a879d","Type":"ContainerStarted","Data":"3fa12d761c15e518b723d6bf5bedeee2e3cd0c546e08f379c90a36da89c42241"} Jul 06 19:50:19.350253 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.350159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7vsx\" (UniqueName: \"kubernetes.io/projected/ab8700a8-83c5-4701-b4da-18c46816b7d6-kube-api-access-q7vsx\") pod \"tuned-9jqsr\" (UID: \"ab8700a8-83c5-4701-b4da-18c46816b7d6\") " pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.370671 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.370381 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:50:19.370671 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.370411 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:50:19.370671 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.370430 2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmmp2 for pod openshift-network-diagnostics/network-check-target-vf2qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:19.370671 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.370507 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2 podName:59e82438-7541-4310-acf6-d7ffecc5d881 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:19.870484583 +0000 UTC m=+3.141238877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kmmp2" (UniqueName: "kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2") pod "network-check-target-vf2qs" (UID: "59e82438-7541-4310-acf6-d7ffecc5d881") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:19.373249 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.373221 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtn8\" (UniqueName: \"kubernetes.io/projected/9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37-kube-api-access-tjtn8\") pod \"multus-7vm2d\" (UID: \"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37\") " pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.373368 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.373313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xdzv\" (UniqueName: \"kubernetes.io/projected/7d9219de-0325-43e7-8d2c-03c225d71885-kube-api-access-5xdzv\") pod \"ovnkube-node-r9rd9\" (UID: \"7d9219de-0325-43e7-8d2c-03c225d71885\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.379546 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.379513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q424\" (UniqueName: \"kubernetes.io/projected/a795b245-ceba-469b-b542-be1f1c8d074f-kube-api-access-9q424\") pod \"node-resolver-rzcpb\" (UID: \"a795b245-ceba-469b-b542-be1f1c8d074f\") " pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.380457 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.380434 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k88zb\" (UniqueName: \"kubernetes.io/projected/005f5b5c-aac6-49fa-b472-c45f523b7846-kube-api-access-k88zb\") pod \"multus-additional-cni-plugins-gjpdf\" (UID: \"005f5b5c-aac6-49fa-b472-c45f523b7846\") " pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.403220 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.403189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5468s" Jul 06 19:50:19.412051 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.411982 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xvgvs" Jul 06 19:50:19.415447 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.415410 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ade938_bfc4_413e_a75b_60e8c08c3c68.slice/crio-23e75c6ead6d418e415fbd335c22426ad01381cf6837815ff91ea4cba9f1512e WatchSource:0}: Error finding container 23e75c6ead6d418e415fbd335c22426ad01381cf6837815ff91ea4cba9f1512e: Status 404 returned error can't find the container with id 23e75c6ead6d418e415fbd335c22426ad01381cf6837815ff91ea4cba9f1512e Jul 06 19:50:19.419186 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.419163 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:19.421252 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.421228 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89498a8d_48b3_45f7_a044_30aeecd7bac9.slice/crio-50904a1d599c934fc30d95e6c3ed0d78d2b0d53dab416de39bc20deb3cec3416 WatchSource:0}: Error finding container 50904a1d599c934fc30d95e6c3ed0d78d2b0d53dab416de39bc20deb3cec3416: Status 404 returned error can't find the container with id 50904a1d599c934fc30d95e6c3ed0d78d2b0d53dab416de39bc20deb3cec3416 Jul 06 19:50:19.424225 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.424204 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" Jul 06 19:50:19.426529 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.426507 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:50:19.429741 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.429547 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzcpb" Jul 06 19:50:19.430376 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.430342 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0496c38_ac84_477d_b564_24abc184e8a7.slice/crio-63cb4a4a8f9257ab6b99256f0643e833334a5ea1f62395138f00eda7a2363a80 WatchSource:0}: Error finding container 63cb4a4a8f9257ab6b99256f0643e833334a5ea1f62395138f00eda7a2363a80: Status 404 returned error can't find the container with id 63cb4a4a8f9257ab6b99256f0643e833334a5ea1f62395138f00eda7a2363a80 Jul 06 19:50:19.434032 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.433974 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cc9abf_fbb9_43b0_a515_5380818c06b2.slice/crio-44e621f9a963475e43cda8b4117e482d867de50b769ba2b746f45a3f77e0a906 WatchSource:0}: Error finding container 44e621f9a963475e43cda8b4117e482d867de50b769ba2b746f45a3f77e0a906: Status 404 returned error can't find the container with id 44e621f9a963475e43cda8b4117e482d867de50b769ba2b746f45a3f77e0a906 Jul 06 19:50:19.435297 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.435276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7vm2d" Jul 06 19:50:19.441355 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.441274 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" Jul 06 19:50:19.445834 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.445811 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb3ad55_8b96_4f37_a8bd_e3c67a9dfa37.slice/crio-c9ca595d56255e6c4ccc0e92602e6936fd289fd326834774a002a95d67bb647a WatchSource:0}: Error finding container c9ca595d56255e6c4ccc0e92602e6936fd289fd326834774a002a95d67bb647a: Status 404 returned error can't find the container with id c9ca595d56255e6c4ccc0e92602e6936fd289fd326834774a002a95d67bb647a Jul 06 19:50:19.446908 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.446887 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:19.450868 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.450848 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" Jul 06 19:50:19.460987 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.460964 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005f5b5c_aac6_49fa_b472_c45f523b7846.slice/crio-9ca30bd29c55a1aa8d92678d065f0a095832b40520e7251c145cd0b38cedc8b0 WatchSource:0}: Error finding container 9ca30bd29c55a1aa8d92678d065f0a095832b40520e7251c145cd0b38cedc8b0: Status 404 returned error can't find the container with id 9ca30bd29c55a1aa8d92678d065f0a095832b40520e7251c145cd0b38cedc8b0 Jul 06 19:50:19.461849 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.461827 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9219de_0325_43e7_8d2c_03c225d71885.slice/crio-3441011433ce137f228f6573efceb7ac9b3b024785d4ced8a8ae8f807dea05db WatchSource:0}: Error finding container 3441011433ce137f228f6573efceb7ac9b3b024785d4ced8a8ae8f807dea05db: Status 404 returned error can't find the container with id 3441011433ce137f228f6573efceb7ac9b3b024785d4ced8a8ae8f807dea05db Jul 06 19:50:19.464696 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:19.464664 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8700a8_83c5_4701_b4da_18c46816b7d6.slice/crio-6469013871d38dde4b91b1ebd0e0ea0af05ab22860b5d11a26d2824b4c42e5a8 WatchSource:0}: Error finding container 6469013871d38dde4b91b1ebd0e0ea0af05ab22860b5d11a26d2824b4c42e5a8: Status 404 returned error can't find the container with id 6469013871d38dde4b91b1ebd0e0ea0af05ab22860b5d11a26d2824b4c42e5a8 Jul 06 19:50:19.718181 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.718081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:19.718311 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.718236 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:19.718311 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.718293 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:20.718278749 +0000 UTC m=+3.989033029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:19.818593 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.818553 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:19.818763 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.818745 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:19.818839 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.818826 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret podName:8716a40a-a752-453a-88e0-c096ed8ee208 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:20.818806625 +0000 UTC m=+4.089560932 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret") pod "global-pull-secret-syncer-vjlns" (UID: "8716a40a-a752-453a-88e0-c096ed8ee208") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:19.919198 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:19.919165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:19.919378 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.919361 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:50:19.919429 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.919388 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:50:19.919429 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.919401 2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmmp2 for pod openshift-network-diagnostics/network-check-target-vf2qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:19.919501 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:19.919459 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2 podName:59e82438-7541-4310-acf6-d7ffecc5d881 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:20.919444045 +0000 UTC m=+4.190198325 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmmp2" (UniqueName: "kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2") pod "network-check-target-vf2qs" (UID: "59e82438-7541-4310-acf6-d7ffecc5d881") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:20.194916 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.194800 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:45:19 +0000 UTC" deadline="2028-03-11 15:20:34.661846587 +0000 UTC" Jul 06 19:50:20.194916 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.194856 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14731h30m14.466994513s" Jul 06 19:50:20.326127 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.326084 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"3441011433ce137f228f6573efceb7ac9b3b024785d4ced8a8ae8f807dea05db"} Jul 06 19:50:20.327582 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.327550 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" event={"ID":"85cc9abf-fbb9-43b0-a515-5380818c06b2","Type":"ContainerStarted","Data":"44e621f9a963475e43cda8b4117e482d867de50b769ba2b746f45a3f77e0a906"} Jul 06 19:50:20.329039 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.328866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zq4sk" event={"ID":"d0496c38-ac84-477d-b564-24abc184e8a7","Type":"ContainerStarted","Data":"63cb4a4a8f9257ab6b99256f0643e833334a5ea1f62395138f00eda7a2363a80"} Jul 06 19:50:20.330320 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.330298 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xvgvs" event={"ID":"89498a8d-48b3-45f7-a044-30aeecd7bac9","Type":"ContainerStarted","Data":"50904a1d599c934fc30d95e6c3ed0d78d2b0d53dab416de39bc20deb3cec3416"} Jul 06 19:50:20.331865 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.331838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5468s" event={"ID":"89ade938-bfc4-413e-a75b-60e8c08c3c68","Type":"ContainerStarted","Data":"23e75c6ead6d418e415fbd335c22426ad01381cf6837815ff91ea4cba9f1512e"} Jul 06 19:50:20.333202 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.333179 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" event={"ID":"ab8700a8-83c5-4701-b4da-18c46816b7d6","Type":"ContainerStarted","Data":"6469013871d38dde4b91b1ebd0e0ea0af05ab22860b5d11a26d2824b4c42e5a8"} Jul 06 19:50:20.334535 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.334511 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vm2d" event={"ID":"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37","Type":"ContainerStarted","Data":"c9ca595d56255e6c4ccc0e92602e6936fd289fd326834774a002a95d67bb647a"} Jul 06 19:50:20.335894 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.335848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzcpb" event={"ID":"a795b245-ceba-469b-b542-be1f1c8d074f","Type":"ContainerStarted","Data":"903e9f487a5470fc42b21d1568b540bbd6e551918b266da74b51df1aa7d24b2d"} Jul 06 19:50:20.337266 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.337238 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerStarted","Data":"9ca30bd29c55a1aa8d92678d065f0a095832b40520e7251c145cd0b38cedc8b0"} Jul 06 19:50:20.726685 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.726108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:20.726685 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.726253 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:20.726685 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.726319 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:22.726300607 +0000 UTC m=+5.997054895 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:20.828043 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.827430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:20.828043 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.827600 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:20.828043 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.827668 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret podName:8716a40a-a752-453a-88e0-c096ed8ee208 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:22.827647589 +0000 UTC m=+6.098401888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret") pod "global-pull-secret-syncer-vjlns" (UID: "8716a40a-a752-453a-88e0-c096ed8ee208") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:20.929090 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:20.928393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:20.929090 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.928619 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:50:20.929090 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.928637 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:50:20.929090 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.928650 2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmmp2 for pod openshift-network-diagnostics/network-check-target-vf2qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:20.929090 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:20.928725 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2 podName:59e82438-7541-4310-acf6-d7ffecc5d881 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:22.928707453 +0000 UTC m=+6.199461752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmmp2" (UniqueName: "kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2") pod "network-check-target-vf2qs" (UID: "59e82438-7541-4310-acf6-d7ffecc5d881") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:21.196001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:21.195894 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:45:19 +0000 UTC" deadline="2028-01-06 02:31:58.111388337 +0000 UTC" Jul 06 19:50:21.196001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:21.195938 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13158h41m36.915455616s" Jul 06 19:50:21.317223 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:21.317058 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:21.317223 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:21.317188 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:21.317454 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:21.317270 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:21.317454 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:21.317341 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:21.317559 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:21.317459 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:21.317605 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:21.317577 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:22.367273 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:22.367025 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" event={"ID":"8599849733ad70aaa09ca90f957a879d","Type":"ContainerStarted","Data":"516e9fc27b9622ad00bc01aa610a82d2575a5ac8d2f49b00e6e4ed132512fcca"} Jul 06 19:50:22.743873 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:22.743026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:22.743873 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.743174 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:22.743873 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.743246 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:26.743225863 +0000 UTC m=+10.013980148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:22.844721 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:22.844118 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:22.844721 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.844273 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:22.844721 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.844338 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret podName:8716a40a-a752-453a-88e0-c096ed8ee208 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:26.844319706 +0000 UTC m=+10.115073989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret") pod "global-pull-secret-syncer-vjlns" (UID: "8716a40a-a752-453a-88e0-c096ed8ee208") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:22.945328 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:22.945166 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:22.945740 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.945639 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:50:22.945740 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.945669 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:50:22.945740 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.945684 2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmmp2 for pod openshift-network-diagnostics/network-check-target-vf2qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:22.946413 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:22.946010 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2 podName:59e82438-7541-4310-acf6-d7ffecc5d881 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:26.945987673 +0000 UTC m=+10.216741971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmmp2" (UniqueName: "kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2") pod "network-check-target-vf2qs" (UID: "59e82438-7541-4310-acf6-d7ffecc5d881") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:23.314507 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:23.314390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:23.314507 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:23.314390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:23.314861 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:23.314519 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:23.314861 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:23.314510 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:23.314861 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:23.314634 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:23.314861 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:23.314757 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:23.371107 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:23.371054 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" event={"ID":"212c55d9504a9d4829be9a08210315e9","Type":"ContainerStarted","Data":"cf1c5a419d60c4aff825ab73c7c33deadbb48604c018ab99cf8a59d797afecf3"} Jul 06 19:50:23.391118 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:23.391059 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-185.ec2.internal" podStartSLOduration=5.391041711 podStartE2EDuration="5.391041711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:22.388822975 +0000 UTC m=+5.659577281" watchObservedRunningTime="2026-07-06 19:50:23.391041711 +0000 UTC m=+6.661796073" Jul 06 19:50:25.314675 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:25.314570 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:25.315147 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:25.314744 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:25.315264 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:25.315242 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:25.315381 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:25.315359 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:25.315514 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:25.315497 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:25.315635 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:25.315599 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:25.377770 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:25.377733 2558 generic.go:356] "Generic (PLEG): container finished" podID="212c55d9504a9d4829be9a08210315e9" containerID="cf1c5a419d60c4aff825ab73c7c33deadbb48604c018ab99cf8a59d797afecf3" exitCode=0 Jul 06 19:50:25.377957 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:25.377787 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" event={"ID":"212c55d9504a9d4829be9a08210315e9","Type":"ContainerDied","Data":"cf1c5a419d60c4aff825ab73c7c33deadbb48604c018ab99cf8a59d797afecf3"} Jul 06 19:50:26.779468 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:26.779430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:26.779967 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.779612 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:26.779967 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.779711 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:34.779688922 +0000 UTC m=+18.050443217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:26.880426 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:26.880381 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:26.880628 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.880561 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:26.880725 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.880670 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret podName:8716a40a-a752-453a-88e0-c096ed8ee208 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:34.880629309 +0000 UTC m=+18.151383606 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret") pod "global-pull-secret-syncer-vjlns" (UID: "8716a40a-a752-453a-88e0-c096ed8ee208") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:26.980758 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:26.980714 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:26.980949 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.980926 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:50:26.980995 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.980961 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:50:26.980995 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.980977 2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmmp2 for pod openshift-network-diagnostics/network-check-target-vf2qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:26.981077 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:26.981036 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2 podName:59e82438-7541-4310-acf6-d7ffecc5d881 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:34.981022097 +0000 UTC m=+18.251776377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmmp2" (UniqueName: "kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2") pod "network-check-target-vf2qs" (UID: "59e82438-7541-4310-acf6-d7ffecc5d881") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:27.315791 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:27.315756 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:27.315967 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:27.315875 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:27.315967 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:27.315882 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:27.316106 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:27.315971 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:27.316106 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:27.315995 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:27.316106 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:27.316071 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:29.314927 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:29.314892 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:29.315406 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:29.314936 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:29.315406 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:29.314889 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:29.315406 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:29.315027 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:29.315406 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:29.315146 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:29.315406 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:29.315276 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:31.314676 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.314627 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:31.315202 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.314627 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:31.315202 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:31.314754 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:31.315202 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:31.314855 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:31.315202 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.314627 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:31.315202 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:31.314941 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:31.392345 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.391955 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzcpb" event={"ID":"a795b245-ceba-469b-b542-be1f1c8d074f","Type":"ContainerStarted","Data":"8c5093d46549d509abd1f00a48cab4d1f073b4f4ad402057c50c41ad71b3cc70"} Jul 06 19:50:31.394120 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.394093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" event={"ID":"212c55d9504a9d4829be9a08210315e9","Type":"ContainerStarted","Data":"3aa876309c8277eac24132acf23ba83093c91646c01e7ab6c4bf802cebdf04a8"} Jul 06 19:50:31.396024 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.396001 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerStarted","Data":"b565ba517ac7c8a235dae5319029c0f9a7d0e0ef1f693b0424293d6260b5216e"} Jul 06 19:50:31.397781 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.397759 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" event={"ID":"85cc9abf-fbb9-43b0-a515-5380818c06b2","Type":"ContainerStarted","Data":"00eb81e9a942d7d8074723f6b5476b71f34589bf1d7ac7c5b429be9bad34a401"} Jul 06 19:50:31.400070 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.399753 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zq4sk" event={"ID":"d0496c38-ac84-477d-b564-24abc184e8a7","Type":"ContainerStarted","Data":"875d61d13dcee4eebb9b190e17c0f8ce9ef90683feae731fbd0bbf08f69668d4"} Jul 06 19:50:31.401330 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.401267 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5468s" event={"ID":"89ade938-bfc4-413e-a75b-60e8c08c3c68","Type":"ContainerStarted","Data":"5230af460254ece200d6f68e8273ba3d1f2a0ea47325cd0f10d8271b853a617b"} Jul 06 19:50:31.439370 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.439278 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rzcpb" podStartSLOduration=2.431119128 podStartE2EDuration="13.439264786s" totalImagesPullingTime="11.008145658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:31.413036057 +0000 UTC m=+14.683790358" watchObservedRunningTime="2026-07-06 19:50:31.439264786 +0000 UTC m=+14.710019084" Jul 06 19:50:31.454075 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.454018 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-185.ec2.internal" podStartSLOduration=13.453995939 podStartE2EDuration="13.453995939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:31.4539101 +0000 UTC m=+14.724664404" watchObservedRunningTime="2026-07-06 19:50:31.453995939 +0000 UTC m=+14.724750240" Jul 06 19:50:31.473460 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.473413 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zq4sk" podStartSLOduration=2.454308455 podStartE2EDuration="13.473394841s" totalImagesPullingTime="11.019086386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:31.473171483 +0000 UTC m=+14.743925784" watchObservedRunningTime="2026-07-06 19:50:31.473394841 +0000 UTC m=+14.744149142" Jul 06 19:50:31.489203 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:31.489154 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5468s" podStartSLOduration=2.453410664 podStartE2EDuration="13.489141028s" totalImagesPullingTime="11.035730364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:31.488490811 +0000 UTC m=+14.759245111" watchObservedRunningTime="2026-07-06 19:50:31.489141028 +0000 UTC m=+14.759895327" Jul 06 19:50:32.405661 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:32.405390 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xvgvs" event={"ID":"89498a8d-48b3-45f7-a044-30aeecd7bac9","Type":"ContainerStarted","Data":"d6ce877bec248d0e0b536cbdb43b679fb01b10556be43ba7416baf276d989acc"} Jul 06 19:50:32.423187 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:32.423136 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xvgvs" podStartSLOduration=3.396429996 podStartE2EDuration="14.423119725s" totalImagesPullingTime="11.026689729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:32.422544777 +0000 UTC m=+15.693299075" watchObservedRunningTime="2026-07-06 19:50:32.423119725 +0000 UTC m=+15.693874024" Jul 06 19:50:33.314672 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:33.314597 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:33.314672 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:33.314612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:33.314672 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:33.314613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:33.314932 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:33.314742 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:33.314932 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:33.314814 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:33.314932 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:33.314898 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:34.843493 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:34.843410 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:34.844081 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:34.843593 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:34.844081 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:34.843697 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:50.843677886 +0000 UTC m=+34.114432170 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:34.944530 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:34.944497 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:34.944724 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:34.944611 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:34.944724 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:34.944688 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret podName:8716a40a-a752-453a-88e0-c096ed8ee208 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:50.9446737 +0000 UTC m=+34.215427979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret") pod "global-pull-secret-syncer-vjlns" (UID: "8716a40a-a752-453a-88e0-c096ed8ee208") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:35.044850 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.044813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:35.045036 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:35.045007 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:50:35.045036 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:35.045039 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:50:35.045204 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:35.045053 2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmmp2 for pod openshift-network-diagnostics/network-check-target-vf2qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:35.045204 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:35.045121 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2 podName:59e82438-7541-4310-acf6-d7ffecc5d881 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:51.04510158 +0000 UTC m=+34.315855863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmmp2" (UniqueName: "kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2") pod "network-check-target-vf2qs" (UID: "59e82438-7541-4310-acf6-d7ffecc5d881") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:35.314830 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.314797 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:35.314830 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.314842 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:35.315075 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:35.314942 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:35.315075 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:35.314991 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:35.315075 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.315034 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:35.315238 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:35.315125 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:35.412757 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.412722 2558 generic.go:356] "Generic (PLEG): container finished" podID="005f5b5c-aac6-49fa-b472-c45f523b7846" containerID="b565ba517ac7c8a235dae5319029c0f9a7d0e0ef1f693b0424293d6260b5216e" exitCode=0 Jul 06 19:50:35.412934 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.412780 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerDied","Data":"b565ba517ac7c8a235dae5319029c0f9a7d0e0ef1f693b0424293d6260b5216e"} Jul 06 19:50:35.644587 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.644506 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:35.645142 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:35.645112 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:37.315329 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:37.315299 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:37.315908 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:37.315375 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:37.315908 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:37.315467 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:37.315908 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:37.315558 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:37.315908 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:37.315611 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:37.315908 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:37.315713 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:39.314884 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:39.314662 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:39.315285 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:39.314992 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:39.315355 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:39.315336 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:39.315404 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:39.315356 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:39.315478 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:39.315451 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:39.315560 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:39.315544 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:39.422997 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:39.422957 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" event={"ID":"ab8700a8-83c5-4701-b4da-18c46816b7d6","Type":"ContainerStarted","Data":"b38128d88055cea70ed1548b5e1973ead2bc17cfdfed30adca4f6e6a3138b0bf"} Jul 06 19:50:39.424590 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:39.424562 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7vm2d" event={"ID":"9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37","Type":"ContainerStarted","Data":"47b90175d7e8829ece6f769e8e70e88faa0af5ca6b9154b744fd38b50b70f4c0"} Jul 06 19:50:39.443240 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:39.443193 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9jqsr" podStartSLOduration=1.9228236349999999 podStartE2EDuration="21.443176142s" totalImagesPullingTime="19.520352507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:39.442900458 +0000 UTC m=+22.713654758" watchObservedRunningTime="2026-07-06 19:50:39.443176142 +0000 UTC m=+22.713930443" Jul 06 19:50:39.462271 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:39.462223 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7vm2d" podStartSLOduration=1.893848931 podStartE2EDuration="21.462209576s" totalImagesPullingTime="19.568360645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:39.461859681 +0000 UTC m=+22.732613982" watchObservedRunningTime="2026-07-06 19:50:39.462209576 +0000 UTC m=+22.732963875" Jul 06 19:50:40.015466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.015265 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:50:40.161038 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.160850 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:50:40.01546447Z","UUID":"4db06bbc-e8f3-417c-afe4-fb096d083d0b","Handler":null,"Name":"","Endpoint":""} Jul 06 19:50:40.162496 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.162476 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:50:40.162617 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.162517 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:50:40.429467 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.429434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"72d996540cb05d96152b51d4176b79d15a82aa0304470efdae37f504313d8d6c"} Jul 06 19:50:40.430045 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.429501 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"05cffc435dc53b528023212208709fd87bd5ea8dcbf2678022db2244ae62077a"} Jul 06 19:50:40.430045 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.429578 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"966a6e82d7d86f1919a9748c409d9e122461c7905d0fc544aa55ad3d6538637c"} Jul 06 19:50:40.430045 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.429613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"e2540f7d7b129c047d140f3bdaa5f5b53b770e058d0b1e2dac1f1290b6b73b23"} Jul 06 19:50:40.430045 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.429673 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"bd3e56c975ee80af5bf9d645c80e6061a07d1c2621cbcbc9ced02176d4a837a4"} Jul 06 19:50:40.430045 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.429707 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"87b495723fc1dc205f1e5b02a10db2d32f4a8bcd62e5b22d91a8bcd05f79b119"} Jul 06 19:50:40.431754 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:40.431729 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" event={"ID":"85cc9abf-fbb9-43b0-a515-5380818c06b2","Type":"ContainerStarted","Data":"d72fd1c0b0fb367374c5cadf954df302f468ce9d34280c95078fa19c13d2d112"} Jul 06 19:50:41.314185 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:41.314145 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:41.314185 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:41.314161 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:41.314505 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:41.314284 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:41.314505 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:41.314282 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:41.314505 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:41.314404 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:41.314505 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:41.314490 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:41.435814 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:41.435781 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" event={"ID":"85cc9abf-fbb9-43b0-a515-5380818c06b2","Type":"ContainerStarted","Data":"86bdc9209956b580480880c3fedc8505d340e50c4dc44ab6349bbcf009a0d71b"} Jul 06 19:50:41.453540 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:41.453498 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dtfkf" podStartSLOduration=2.206689638 podStartE2EDuration="23.453485507s" totalImagesPullingTime="21.246795869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:41.453276968 +0000 UTC m=+24.724031268" watchObservedRunningTime="2026-07-06 19:50:41.453485507 +0000 UTC m=+24.724239806" Jul 06 19:50:43.314854 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:43.314822 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:43.314854 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:43.314848 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:43.315383 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:43.314827 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:43.315383 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:43.314949 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:43.315383 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:43.315023 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:43.315383 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:43.315115 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:43.444264 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:43.444218 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"13f84e189de416a7d00e4033862ef1e85ec963a71ac2cecab51346840db93130"} Jul 06 19:50:45.314484 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.314313 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:45.315068 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.314313 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:45.315068 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:45.314557 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:45.315068 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.314371 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:45.315068 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:45.314630 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:45.315068 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:45.314699 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:45.449800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.449772 2558 generic.go:356] "Generic (PLEG): container finished" podID="005f5b5c-aac6-49fa-b472-c45f523b7846" containerID="7f3e1d5f3dc3494ae07b20600c8cc9e7f7336ea3298636facfe22b2cfcf24901" exitCode=0 Jul 06 19:50:45.449980 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.449841 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerDied","Data":"7f3e1d5f3dc3494ae07b20600c8cc9e7f7336ea3298636facfe22b2cfcf24901"} Jul 06 19:50:45.453182 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.453158 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" event={"ID":"7d9219de-0325-43e7-8d2c-03c225d71885","Type":"ContainerStarted","Data":"b88c3c40decd44f8d5aa70ad15d3be47d1b2411a2f1926058cb43ed6675b8277"} Jul 06 19:50:45.453416 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.453392 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:45.453491 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.453443 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:45.457174 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.457151 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:45.457272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.457261 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 19:50:45.457647 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.457617 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zq4sk" Jul 06 19:50:45.467794 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.467778 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:45.503731 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:45.503682 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" podStartSLOduration=7.366917707 podStartE2EDuration="27.503667723s" totalImagesPullingTime="20.136750016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:45.50244231 +0000 UTC m=+28.773196644" watchObservedRunningTime="2026-07-06 19:50:45.503667723 +0000 UTC m=+28.774422023" Jul 06 19:50:46.457511 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.457370 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:46.462487 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.462461 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vjlns"] Jul 06 19:50:46.462601 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.462565 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:46.462756 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:46.462668 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:46.465217 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.465175 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkhqs"] Jul 06 19:50:46.465338 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.465273 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:46.465424 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:46.465368 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:46.472080 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.471493 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vf2qs"] Jul 06 19:50:46.472080 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.471581 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:46.472080 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:46.471684 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:46.477100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:46.477079 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:50:47.460215 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:47.460184 2558 generic.go:356] "Generic (PLEG): container finished" podID="005f5b5c-aac6-49fa-b472-c45f523b7846" containerID="4de8a9b29ab49e41549f402003e25bb0a91e7abbb534cefddf1810fb0aa530aa" exitCode=0 Jul 06 19:50:47.460573 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:47.460248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerDied","Data":"4de8a9b29ab49e41549f402003e25bb0a91e7abbb534cefddf1810fb0aa530aa"} Jul 06 19:50:48.314943 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:48.314912 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:48.315099 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:48.314987 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:48.315099 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:48.315012 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:48.315099 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:48.314924 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:48.315099 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:48.315083 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:48.315269 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:48.315171 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:49.466609 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:49.466451 2558 generic.go:356] "Generic (PLEG): container finished" podID="005f5b5c-aac6-49fa-b472-c45f523b7846" containerID="55b8fbde2ee2ad7f0db718b91887f9dccd0b2e16e07638fc3460ed67567ddc4b" exitCode=0 Jul 06 19:50:49.467034 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:49.466517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerDied","Data":"55b8fbde2ee2ad7f0db718b91887f9dccd0b2e16e07638fc3460ed67567ddc4b"} Jul 06 19:50:50.314302 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:50.314263 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:50.314302 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:50.314296 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:50.314524 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:50.314312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:50.314524 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:50.314405 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:50.314524 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:50.314484 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:50.314665 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:50.314573 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:50.859927 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:50.859893 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:50.860566 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:50.860025 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:50.860566 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:50.860080 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:22.860063399 +0000 UTC m=+66.130817677 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:50:50.960900 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:50.960869 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:50.961062 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:50.961048 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:50.961120 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:50.961110 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret podName:8716a40a-a752-453a-88e0-c096ed8ee208 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:22.961094321 +0000 UTC m=+66.231848619 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret") pod "global-pull-secret-syncer-vjlns" (UID: "8716a40a-a752-453a-88e0-c096ed8ee208") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:50:51.061709 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:51.061675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:51.061851 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:51.061827 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:50:51.061851 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:51.061843 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:50:51.061910 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:51.061854 2558 projected.go:196] Error preparing data for projected volume kube-api-access-kmmp2 for pod openshift-network-diagnostics/network-check-target-vf2qs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:51.061910 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:51.061900 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2 podName:59e82438-7541-4310-acf6-d7ffecc5d881 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:23.061887078 +0000 UTC m=+66.332641362 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kmmp2" (UniqueName: "kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2") pod "network-check-target-vf2qs" (UID: "59e82438-7541-4310-acf6-d7ffecc5d881") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:50:52.314392 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:52.314362 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:52.314851 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:52.314362 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:52.314851 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:52.314488 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vjlns" podUID="8716a40a-a752-453a-88e0-c096ed8ee208" Jul 06 19:50:52.314851 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:52.314362 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:52.314851 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:52.314530 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vf2qs" podUID="59e82438-7541-4310-acf6-d7ffecc5d881" Jul 06 19:50:52.314851 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:52.314608 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:50:52.929955 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:52.929895 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-185.ec2.internal" event="NodeReady" Jul 06 19:50:52.930131 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:52.930056 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:50:52.979909 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:52.979878 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv"] Jul 06 19:50:53.003416 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.003389 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8d66dd7c6-2c2th"] Jul 06 19:50:53.003559 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.003510 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:53.006211 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.006192 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 06 19:50:53.006340 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.006245 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lg2mq\"" Jul 06 19:50:53.006488 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.006461 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 06 19:50:53.026061 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.026031 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv"] Jul 06 19:50:53.026184 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.026075 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d66dd7c6-2c2th"] Jul 06 19:50:53.026184 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.026105 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5shln"] Jul 06 19:50:53.026478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.026453 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.029910 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.029890 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:50:53.030215 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.030191 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7fls\"" Jul 06 19:50:53.030292 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.030270 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:50:53.031090 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.031070 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:50:53.036905 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.036887 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:50:53.049554 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.049534 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b9x86"] Jul 06 19:50:53.049659 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.049568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.052467 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.052443 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpgq7\"" Jul 06 19:50:53.052467 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.052447 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:50:53.052616 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.052495 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:50:53.052616 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.052496 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:50:53.071109 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.071089 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b9x86"] Jul 06 19:50:53.071233 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.071134 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5shln"] Jul 06 19:50:53.071293 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.071228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.073781 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.073763 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45vdg\"" Jul 06 19:50:53.073878 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.073790 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:50:53.073878 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.073824 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:50:53.078994 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.078975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/adabb4c7-ecfe-4204-bace-10996203e1f1-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:53.079084 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.079011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:53.180005 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.179942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-ca-trust-extracted\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180005 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.179982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-trusted-ca\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180174 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180008 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-image-registry-private-configuration\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180174 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-bound-sa-token\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180174 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180050 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.180174 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180083 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b82780f1-a844-499d-940a-af73bda34e50-tmp-dir\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.180174 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/adabb4c7-ecfe-4204-bace-10996203e1f1-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:53.180174 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgvhp\" (UniqueName: \"kubernetes.io/projected/b82780f1-a844-499d-940a-af73bda34e50-kube-api-access-wgvhp\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90fab817-e894-4238-ba9a-d1bbb9e27fd9-cert\") pod \"ingress-canary-5shln\" (UID: \"90fab817-e894-4238-ba9a-d1bbb9e27fd9\") " pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b82780f1-a844-499d-940a-af73bda34e50-config-volume\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.180310 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-certificates\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180342 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-installation-pull-secrets\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180385 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.180368 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:53.680349927 +0000 UTC m=+36.951104217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:50:53.180701 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180421 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z55vr\" (UniqueName: \"kubernetes.io/projected/90fab817-e894-4238-ba9a-d1bbb9e27fd9-kube-api-access-z55vr\") pod \"ingress-canary-5shln\" (UID: \"90fab817-e894-4238-ba9a-d1bbb9e27fd9\") " pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.180701 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180472 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbqtk\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-kube-api-access-pbqtk\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.180993 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.180972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/adabb4c7-ecfe-4204-bace-10996203e1f1-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:53.281775 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.281737 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-image-registry-private-configuration\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.281775 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.281780 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-bound-sa-token\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282003 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.281806 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.282003 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.281902 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:50:53.282003 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.281958 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:53.781939261 +0000 UTC m=+37.052693555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:50:53.282003 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.281988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b82780f1-a844-499d-940a-af73bda34e50-tmp-dir\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.282182 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282182 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgvhp\" (UniqueName: \"kubernetes.io/projected/b82780f1-a844-499d-940a-af73bda34e50-kube-api-access-wgvhp\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.282182 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90fab817-e894-4238-ba9a-d1bbb9e27fd9-cert\") pod \"ingress-canary-5shln\" (UID: \"90fab817-e894-4238-ba9a-d1bbb9e27fd9\") " pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.282182 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b82780f1-a844-499d-940a-af73bda34e50-config-volume\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-certificates\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.282207 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.282223 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-installation-pull-secrets\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282248 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z55vr\" (UniqueName: \"kubernetes.io/projected/90fab817-e894-4238-ba9a-d1bbb9e27fd9-kube-api-access-z55vr\") pod \"ingress-canary-5shln\" (UID: \"90fab817-e894-4238-ba9a-d1bbb9e27fd9\") " pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.282263 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:53.782249245 +0000 UTC m=+37.053003546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbqtk\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-kube-api-access-pbqtk\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b82780f1-a844-499d-940a-af73bda34e50-tmp-dir\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.282370 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282355 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-ca-trust-extracted\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282796 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-trusted-ca\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282796 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-ca-trust-extracted\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.282991 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.282969 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-certificates\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.283162 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.283145 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b82780f1-a844-499d-940a-af73bda34e50-config-volume\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.283531 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.283509 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-trusted-ca\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.286661 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.286595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-image-registry-private-configuration\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.286752 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.286733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/90fab817-e894-4238-ba9a-d1bbb9e27fd9-cert\") pod \"ingress-canary-5shln\" (UID: \"90fab817-e894-4238-ba9a-d1bbb9e27fd9\") " pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.287152 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.287133 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-installation-pull-secrets\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.293563 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.293521 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgvhp\" (UniqueName: \"kubernetes.io/projected/b82780f1-a844-499d-940a-af73bda34e50-kube-api-access-wgvhp\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.293848 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.293829 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z55vr\" (UniqueName: \"kubernetes.io/projected/90fab817-e894-4238-ba9a-d1bbb9e27fd9-kube-api-access-z55vr\") pod \"ingress-canary-5shln\" (UID: \"90fab817-e894-4238-ba9a-d1bbb9e27fd9\") " pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.304743 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.304724 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-bound-sa-token\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.305001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.304979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbqtk\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-kube-api-access-pbqtk\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.359316 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.359278 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5shln" Jul 06 19:50:53.685627 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.685590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:53.685804 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.685724 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:50:53.685804 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.685790 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:54.685773532 +0000 UTC m=+37.956527831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:50:53.786745 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.786703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:53.786894 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:53.786787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:53.786894 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.786814 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:50:53.786997 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.786896 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:54.786874789 +0000 UTC m=+38.057629084 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:50:53.786997 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.786939 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:50:53.786997 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.786957 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:50:53.786997 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:53.786996 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:54.78698542 +0000 UTC m=+38.057739698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:50:54.314710 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.314671 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:50:54.314880 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.314716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:50:54.314880 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.314716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:50:54.317593 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.317573 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwg6z\"" Jul 06 19:50:54.317733 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.317614 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:50:54.318904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.318749 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:50:54.318904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.318817 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2fwrm\"" Jul 06 19:50:54.318904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.318879 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:50:54.319074 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.318879 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:50:54.694775 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.694743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:54.695342 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:54.694915 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:50:54.695342 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:54.695046 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:56.695027188 +0000 UTC m=+39.965781467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:50:54.796430 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.796200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:54.796573 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.796463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:54.796573 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:54.796379 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:50:54.796692 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:54.796532 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:50:54.796692 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:54.796621 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:50:54.796692 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:54.796631 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:56.796605078 +0000 UTC m=+40.067359374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:50:54.796692 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:54.796688 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:50:56.796668733 +0000 UTC m=+40.067423013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:50:54.840197 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:54.840168 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5shln"] Jul 06 19:50:54.901681 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:50:54.901649 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fab817_e894_4238_ba9a_d1bbb9e27fd9.slice/crio-e201f921752509c901c847158a8010710720e2f3f8267b0cbb48ca61cbc6d3e1 WatchSource:0}: Error finding container e201f921752509c901c847158a8010710720e2f3f8267b0cbb48ca61cbc6d3e1: Status 404 returned error can't find the container with id e201f921752509c901c847158a8010710720e2f3f8267b0cbb48ca61cbc6d3e1 Jul 06 19:50:55.481005 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:55.480964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5shln" event={"ID":"90fab817-e894-4238-ba9a-d1bbb9e27fd9","Type":"ContainerStarted","Data":"e201f921752509c901c847158a8010710720e2f3f8267b0cbb48ca61cbc6d3e1"} Jul 06 19:50:55.483548 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:55.483506 2558 generic.go:356] "Generic (PLEG): container finished" podID="005f5b5c-aac6-49fa-b472-c45f523b7846" containerID="38fd617ca01d84129a299dbad69abcae05911d368911453cad4eb6f29a18eb6b" exitCode=0 Jul 06 19:50:55.483654 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:55.483570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerDied","Data":"38fd617ca01d84129a299dbad69abcae05911d368911453cad4eb6f29a18eb6b"} Jul 06 19:50:56.489421 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:56.489331 2558 generic.go:356] "Generic (PLEG): container finished" podID="005f5b5c-aac6-49fa-b472-c45f523b7846" containerID="cc1472f3a44a64755e05ea20ebc8a109c65186de921e23842cc2d0fe3552a56a" exitCode=0 Jul 06 19:50:56.489421 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:56.489397 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerDied","Data":"cc1472f3a44a64755e05ea20ebc8a109c65186de921e23842cc2d0fe3552a56a"} Jul 06 19:50:56.712850 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:56.712812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:50:56.713025 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:56.712975 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:50:56.713093 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:56.713065 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:00.71303425 +0000 UTC m=+43.983788534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:50:56.813960 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:56.813872 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:50:56.813960 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:56.813937 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:50:56.814168 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:56.814046 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:50:56.814168 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:56.814072 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:50:56.814168 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:56.814127 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:00.8141122 +0000 UTC m=+44.084866482 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:50:56.814168 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:56.814043 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:50:56.814364 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:50:56.814183 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:00.814171475 +0000 UTC m=+44.084925754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:50:57.496228 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:57.496056 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" event={"ID":"005f5b5c-aac6-49fa-b472-c45f523b7846","Type":"ContainerStarted","Data":"a716d7a9226067dcf12567beb40bd84bc3ad9f85358a6415faabe45da478135a"} Jul 06 19:50:57.520962 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:57.520901 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gjpdf" podStartSLOduration=11.554611616 podStartE2EDuration="39.520882215s" totalImagesPullingTime="27.966270599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:57.518922727 +0000 UTC m=+40.789677023" watchObservedRunningTime="2026-07-06 19:50:57.520882215 +0000 UTC m=+40.791636517" Jul 06 19:50:58.499480 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:58.499444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5shln" event={"ID":"90fab817-e894-4238-ba9a-d1bbb9e27fd9","Type":"ContainerStarted","Data":"30cd48ae92f2ca78f5b85bf731b3c2d0e0f751c9bf4321c79b5c01651087baf4"} Jul 06 19:50:58.514810 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:50:58.514761 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5shln" podStartSLOduration=3.427965649 podStartE2EDuration="6.514747775s" totalImagesPullingTime="3.086782126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:50:58.514228898 +0000 UTC m=+41.784983195" watchObservedRunningTime="2026-07-06 19:50:58.514747775 +0000 UTC m=+41.785502074" Jul 06 19:51:00.745917 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:00.745873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:51:00.746280 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:00.746025 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:51:00.746280 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:00.746093 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:08.746077342 +0000 UTC m=+52.016831632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:51:00.846904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:00.846871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:51:00.847081 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:00.846921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:51:00.847081 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:00.847028 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:51:00.847081 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:00.847044 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:51:00.847081 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:00.847054 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:51:00.847282 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:00.847093 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:08.847081773 +0000 UTC m=+52.117836051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:51:00.847282 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:00.847105 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:08.847099975 +0000 UTC m=+52.117854253 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:51:08.808320 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:08.808270 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:51:08.808789 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:08.808435 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:51:08.808789 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:08.808507 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:24.808490693 +0000 UTC m=+68.079244983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:51:08.908893 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:08.908858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:51:08.908968 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:08.908915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:51:08.909034 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:08.909018 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:51:08.909098 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:08.909088 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:24.909073153 +0000 UTC m=+68.179827436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:51:08.909136 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:08.909021 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:51:08.909169 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:08.909136 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:51:08.909199 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:08.909176 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:24.909164604 +0000 UTC m=+68.179918896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:51:18.472222 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:18.472195 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9rd9" Jul 06 19:51:22.908593 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:22.908533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:51:22.911268 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:22.911248 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:51:22.919245 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:22.919228 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:51:22.919305 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:22.919294 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:52:26.919271152 +0000 UTC m=+130.190025430 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : secret "metrics-daemon-secret" not found Jul 06 19:51:23.009001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.008961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:51:23.011816 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.011799 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:51:23.023481 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.023461 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8716a40a-a752-453a-88e0-c096ed8ee208-original-pull-secret\") pod \"global-pull-secret-syncer-vjlns\" (UID: \"8716a40a-a752-453a-88e0-c096ed8ee208\") " pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:51:23.109970 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.109934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:51:23.113018 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.113000 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:51:23.122837 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.122819 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:51:23.133149 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.133124 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmmp2\" (UniqueName: \"kubernetes.io/projected/59e82438-7541-4310-acf6-d7ffecc5d881-kube-api-access-kmmp2\") pod \"network-check-target-vf2qs\" (UID: \"59e82438-7541-4310-acf6-d7ffecc5d881\") " pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:51:23.139998 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.139977 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vjlns" Jul 06 19:51:23.254743 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.254709 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vjlns"] Jul 06 19:51:23.258025 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:51:23.257996 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8716a40a_a752_453a_88e0_c096ed8ee208.slice/crio-f3efb74790af40c075ece200e83c4eaa30b3c84a15b88b4690df9d6064eb253c WatchSource:0}: Error finding container f3efb74790af40c075ece200e83c4eaa30b3c84a15b88b4690df9d6064eb253c: Status 404 returned error can't find the container with id f3efb74790af40c075ece200e83c4eaa30b3c84a15b88b4690df9d6064eb253c Jul 06 19:51:23.430439 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.430410 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fwg6z\"" Jul 06 19:51:23.437918 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.437852 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:51:23.557041 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.557001 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vf2qs"] Jul 06 19:51:23.557205 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:23.557112 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vjlns" event={"ID":"8716a40a-a752-453a-88e0-c096ed8ee208","Type":"ContainerStarted","Data":"f3efb74790af40c075ece200e83c4eaa30b3c84a15b88b4690df9d6064eb253c"} Jul 06 19:51:23.559837 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:51:23.559817 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e82438_7541_4310_acf6_d7ffecc5d881.slice/crio-8bdecceea5eb71bda10bca6f2a26a6eeeaec7eb424b3111c1d91071b4a9bd536 WatchSource:0}: Error finding container 8bdecceea5eb71bda10bca6f2a26a6eeeaec7eb424b3111c1d91071b4a9bd536: Status 404 returned error can't find the container with id 8bdecceea5eb71bda10bca6f2a26a6eeeaec7eb424b3111c1d91071b4a9bd536 Jul 06 19:51:24.561456 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:24.561415 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vf2qs" event={"ID":"59e82438-7541-4310-acf6-d7ffecc5d881","Type":"ContainerStarted","Data":"8bdecceea5eb71bda10bca6f2a26a6eeeaec7eb424b3111c1d91071b4a9bd536"} Jul 06 19:51:24.822222 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:24.822134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:51:24.822384 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:24.822304 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:51:24.822444 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:24.822388 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:56.822366205 +0000 UTC m=+100.093120487 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:51:24.923430 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:24.923386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:51:24.923608 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:24.923490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:51:24.923608 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:24.923561 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:51:24.923608 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:24.923579 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:51:24.923608 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:24.923588 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:51:24.923842 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:24.923656 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:56.923617315 +0000 UTC m=+100.194371594 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:51:24.923842 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:24.923673 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:51:56.923666015 +0000 UTC m=+100.194420294 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:51:29.576713 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:29.576599 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vf2qs" event={"ID":"59e82438-7541-4310-acf6-d7ffecc5d881","Type":"ContainerStarted","Data":"7395a4c2098783b406aae726c87758947982d3b172db8c557029c30a152fe1a9"} Jul 06 19:51:29.576713 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:29.576683 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:51:29.577996 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:29.577970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vjlns" event={"ID":"8716a40a-a752-453a-88e0-c096ed8ee208","Type":"ContainerStarted","Data":"a5ba7e96908bf24207aeab4c1b4530162d344132de07d748a679714a487f2862"} Jul 06 19:51:29.597964 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:29.597914 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vf2qs" podStartSLOduration=65.88304443 podStartE2EDuration="1m11.597900223s" totalImagesPullingTime="5.714855793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:29.597533182 +0000 UTC m=+72.868287482" watchObservedRunningTime="2026-07-06 19:51:29.597900223 +0000 UTC m=+72.868654554" Jul 06 19:51:29.615607 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:29.615556 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vjlns" podStartSLOduration=65.588625404 podStartE2EDuration="1m11.615508079s" totalImagesPullingTime="6.026882675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:51:29.614784377 +0000 UTC m=+72.885538676" watchObservedRunningTime="2026-07-06 19:51:29.615508079 +0000 UTC m=+72.886262379" Jul 06 19:51:56.851188 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:56.851147 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:51:56.851580 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:56.851295 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:51:56.851580 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:56.851375 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:53:00.851357666 +0000 UTC m=+164.122111944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:51:56.951808 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:56.951775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:51:56.951906 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:51:56.951826 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:51:56.951940 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:56.951928 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:51:56.951940 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:56.951931 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:51:56.952011 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:56.952001 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:53:00.951985403 +0000 UTC m=+164.222739682 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:51:56.952056 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:56.951939 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:51:56.952091 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:51:56.952068 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:53:00.952055802 +0000 UTC m=+164.222810080 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:52:00.582095 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:52:00.582061 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vf2qs" Jul 06 19:52:26.970773 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:52:26.970719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:52:26.971165 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:52:26.970874 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:52:26.971165 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:52:26.970973 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:28.970955274 +0000 UTC m=+252.241709560 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : secret "metrics-daemon-secret" not found Jul 06 19:52:56.012982 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:52:56.012927 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" podUID="adabb4c7-ecfe-4204-bace-10996203e1f1" Jul 06 19:52:56.037128 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:52:56.037097 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" podUID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" Jul 06 19:52:56.081030 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:52:56.081001 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b9x86" podUID="b82780f1-a844-499d-940a-af73bda34e50" Jul 06 19:52:56.779898 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:52:56.779871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:52:57.334017 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:52:57.333978 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:53:00.928852 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:53:00.928816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:53:00.929255 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:53:00.928916 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:53:00.929255 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:53:00.928966 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:02.928952016 +0000 UTC m=+286.199706294 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:53:01.029098 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:53:01.029065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:53:01.029187 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:53:01.029116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:53:01.029229 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:53:01.029216 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:53:01.029265 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:53:01.029217 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:53:01.029305 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:53:01.029293 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls podName:b82780f1-a844-499d-940a-af73bda34e50 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:03.029276969 +0000 UTC m=+286.300031251 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls") pod "dns-default-b9x86" (UID: "b82780f1-a844-499d-940a-af73bda34e50") : secret "dns-default-metrics-tls" not found Jul 06 19:53:01.029349 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:53:01.029228 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8d66dd7c6-2c2th: secret "image-registry-tls" not found Jul 06 19:53:01.029380 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:53:01.029350 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls podName:bdaa6929-3ff9-4a46-ad30-ca2a8962f509 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:03.029339584 +0000 UTC m=+286.300093862 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls") pod "image-registry-8d66dd7c6-2c2th" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509") : secret "image-registry-tls" not found Jul 06 19:53:09.314503 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:53:09.314416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:53:09.314503 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:53:09.314423 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9x86" Jul 06 19:53:12.314739 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:53:12.314697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:54:29.041438 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:29.041393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:54:29.041952 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:29.041507 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:54:29.041952 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:29.041567 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs podName:0728ac1f-e602-41f4-8133-77a0fb7696a7 nodeName:}" failed. No retries permitted until 2026-07-06 19:56:31.041553631 +0000 UTC m=+374.312307910 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs") pod "network-metrics-daemon-jkhqs" (UID: "0728ac1f-e602-41f4-8133-77a0fb7696a7") : secret "metrics-daemon-secret" not found Jul 06 19:54:46.040995 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.040921 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck"] Jul 06 19:54:46.042649 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.042619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" Jul 06 19:54:46.044157 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.044135 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv"] Jul 06 19:54:46.045334 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.045315 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 19:54:46.045419 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.045364 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:54:46.045419 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.045369 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bls24\"" Jul 06 19:54:46.045913 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.045899 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nnvn2"] Jul 06 19:54:46.046034 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.046019 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:46.047512 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.047495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.048522 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.048502 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ckhjz\"" Jul 06 19:54:46.048759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.048746 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 19:54:46.048964 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.048949 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:54:46.049233 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.049216 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 19:54:46.049711 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.049697 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bczp7\"" Jul 06 19:54:46.050001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.049987 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 19:54:46.050237 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.050222 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:54:46.050316 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.050223 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 19:54:46.050792 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.050561 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 19:54:46.056335 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.056198 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 19:54:46.056790 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.056773 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck"] Jul 06 19:54:46.058533 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.058514 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv"] Jul 06 19:54:46.061036 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.061015 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nnvn2"] Jul 06 19:54:46.130207 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.130176 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-s48wt"] Jul 06 19:54:46.132241 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.132225 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9"] Jul 06 19:54:46.132367 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.132351 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.133877 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.133862 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" Jul 06 19:54:46.134930 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.134909 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 06 19:54:46.135034 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.134941 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 06 19:54:46.135034 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.134954 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:54:46.135034 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.134911 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:54:46.135431 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.135416 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8vgsj\"" Jul 06 19:54:46.136747 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.136732 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-fffjr\"" Jul 06 19:54:46.140757 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.140739 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 06 19:54:46.143050 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.143031 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9"] Jul 06 19:54:46.146860 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.146840 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-s48wt"] Jul 06 19:54:46.161533 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/895d20fb-5c6e-42e3-a9e8-9607be369c02-config\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.161658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.161658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161561 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-tmp\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.161658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.161658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161600 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-snapshots\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.161800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161689 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:46.161800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161712 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67rxp\" (UniqueName: \"kubernetes.io/projected/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-kube-api-access-67rxp\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.161800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nt4w\" (UniqueName: \"kubernetes.io/projected/3d807a3a-be54-4477-9781-c339d7db2781-kube-api-access-6nt4w\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:46.161800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161756 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-serving-cert\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.161800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gh87\" (UniqueName: \"kubernetes.io/projected/856d23cb-62b2-4d6e-bcdc-644be7044193-kube-api-access-9gh87\") pod \"volume-data-source-validator-5d456fdbcd-hmgck\" (UID: \"856d23cb-62b2-4d6e-bcdc-644be7044193\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" Jul 06 19:54:46.161955 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161812 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/895d20fb-5c6e-42e3-a9e8-9607be369c02-trusted-ca\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.161955 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161828 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrh8x\" (UniqueName: \"kubernetes.io/projected/895d20fb-5c6e-42e3-a9e8-9607be369c02-kube-api-access-wrh8x\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.161955 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.161898 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/895d20fb-5c6e-42e3-a9e8-9607be369c02-serving-cert\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.219784 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.219748 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c"] Jul 06 19:54:46.221499 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.221484 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.223999 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.223981 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:54:46.223999 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.223992 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4m2z5\"" Jul 06 19:54:46.224180 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.223993 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:54:46.224180 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.223993 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:54:46.224180 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.224132 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:54:46.239277 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.239249 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c"] Jul 06 19:54:46.262898 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.262870 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:46.262898 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.262897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67rxp\" (UniqueName: \"kubernetes.io/projected/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-kube-api-access-67rxp\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.262916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nt4w\" (UniqueName: \"kubernetes.io/projected/3d807a3a-be54-4477-9781-c339d7db2781-kube-api-access-6nt4w\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.262933 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-serving-cert\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.262952 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gh87\" (UniqueName: \"kubernetes.io/projected/856d23cb-62b2-4d6e-bcdc-644be7044193-kube-api-access-9gh87\") pod \"volume-data-source-validator-5d456fdbcd-hmgck\" (UID: \"856d23cb-62b2-4d6e-bcdc-644be7044193\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.262966 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/895d20fb-5c6e-42e3-a9e8-9607be369c02-trusted-ca\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.262981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrh8x\" (UniqueName: \"kubernetes.io/projected/895d20fb-5c6e-42e3-a9e8-9607be369c02-kube-api-access-wrh8x\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:46.263051 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:54:46.263114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:46.263129 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls podName:3d807a3a-be54-4477-9781-c339d7db2781 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:46.763108126 +0000 UTC m=+270.033862408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xkljv" (UID: "3d807a3a-be54-4477-9781-c339d7db2781") : secret "samples-operator-tls" not found Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/895d20fb-5c6e-42e3-a9e8-9607be369c02-serving-cert\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/895d20fb-5c6e-42e3-a9e8-9607be369c02-config\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263375 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-tmp\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsbll\" (UniqueName: \"kubernetes.io/projected/4db4f879-cc41-44bd-b04a-6ab17070a4c3-kube-api-access-tsbll\") pod \"network-check-source-989f8b8dc-djpx9\" (UID: \"4db4f879-cc41-44bd-b04a-6ab17070a4c3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" Jul 06 19:54:46.263478 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-snapshots\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.264006 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263505 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rqrk\" (UniqueName: \"kubernetes.io/projected/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-kube-api-access-5rqrk\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.264006 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-tmp\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.264006 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263875 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/895d20fb-5c6e-42e3-a9e8-9607be369c02-config\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.264006 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.263894 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.264006 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.264002 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/895d20fb-5c6e-42e3-a9e8-9607be369c02-trusted-ca\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.264245 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.264204 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-snapshots\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.264297 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.264264 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.265372 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.265353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-serving-cert\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.265607 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.265592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/895d20fb-5c6e-42e3-a9e8-9607be369c02-serving-cert\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.273244 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.273227 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67rxp\" (UniqueName: \"kubernetes.io/projected/dd4d6d2f-6ab3-4526-860b-96f00868dd9d-kube-api-access-67rxp\") pod \"insights-operator-5c847dcfc4-s48wt\" (UID: \"dd4d6d2f-6ab3-4526-860b-96f00868dd9d\") " pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.273315 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.273252 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gh87\" (UniqueName: \"kubernetes.io/projected/856d23cb-62b2-4d6e-bcdc-644be7044193-kube-api-access-9gh87\") pod \"volume-data-source-validator-5d456fdbcd-hmgck\" (UID: \"856d23cb-62b2-4d6e-bcdc-644be7044193\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" Jul 06 19:54:46.273962 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.273946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrh8x\" (UniqueName: \"kubernetes.io/projected/895d20fb-5c6e-42e3-a9e8-9607be369c02-kube-api-access-wrh8x\") pod \"console-operator-68b757fb67-nnvn2\" (UID: \"895d20fb-5c6e-42e3-a9e8-9607be369c02\") " pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.274720 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.274702 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nt4w\" (UniqueName: \"kubernetes.io/projected/3d807a3a-be54-4477-9781-c339d7db2781-kube-api-access-6nt4w\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:46.353262 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.353178 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" Jul 06 19:54:46.363865 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.363838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.363984 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.363879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.364044 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.364009 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsbll\" (UniqueName: \"kubernetes.io/projected/4db4f879-cc41-44bd-b04a-6ab17070a4c3-kube-api-access-tsbll\") pod \"network-check-source-989f8b8dc-djpx9\" (UID: \"4db4f879-cc41-44bd-b04a-6ab17070a4c3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" Jul 06 19:54:46.364102 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.364044 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rqrk\" (UniqueName: \"kubernetes.io/projected/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-kube-api-access-5rqrk\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.364409 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.364389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.365325 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.365305 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:46.366148 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.366127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.372363 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.372343 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsbll\" (UniqueName: \"kubernetes.io/projected/4db4f879-cc41-44bd-b04a-6ab17070a4c3-kube-api-access-tsbll\") pod \"network-check-source-989f8b8dc-djpx9\" (UID: \"4db4f879-cc41-44bd-b04a-6ab17070a4c3\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" Jul 06 19:54:46.372632 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.372614 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rqrk\" (UniqueName: \"kubernetes.io/projected/a136fc5b-adc8-4f0f-9fb3-5e02aaca810e-kube-api-access-5rqrk\") pod \"kube-storage-version-migrator-operator-846bf668f7-ndn9c\" (UID: \"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.442286 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.442258 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" Jul 06 19:54:46.447936 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.447775 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" Jul 06 19:54:46.482936 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.482879 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck"] Jul 06 19:54:46.487892 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:54:46.487857 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856d23cb_62b2_4d6e_bcdc_644be7044193.slice/crio-9efd0db5c280b812c0d4ca60b66fb956e33758335e77e095b3d884dc778fe4ec WatchSource:0}: Error finding container 9efd0db5c280b812c0d4ca60b66fb956e33758335e77e095b3d884dc778fe4ec: Status 404 returned error can't find the container with id 9efd0db5c280b812c0d4ca60b66fb956e33758335e77e095b3d884dc778fe4ec Jul 06 19:54:46.511702 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.505025 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-nnvn2"] Jul 06 19:54:46.511702 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:54:46.510273 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod895d20fb_5c6e_42e3_a9e8_9607be369c02.slice/crio-335815bdde58b4c652405639442938b90b60f1cd17b4f7c95e72b9852b9bc0ed WatchSource:0}: Error finding container 335815bdde58b4c652405639442938b90b60f1cd17b4f7c95e72b9852b9bc0ed: Status 404 returned error can't find the container with id 335815bdde58b4c652405639442938b90b60f1cd17b4f7c95e72b9852b9bc0ed Jul 06 19:54:46.529622 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.529594 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" Jul 06 19:54:46.586220 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.586141 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-s48wt"] Jul 06 19:54:46.600080 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.600058 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9"] Jul 06 19:54:46.602513 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:54:46.602489 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db4f879_cc41_44bd_b04a_6ab17070a4c3.slice/crio-43d1bea11ff1be0d13b90ecd84e62bdf35b5bef73241726cf57c988cd0a70e64 WatchSource:0}: Error finding container 43d1bea11ff1be0d13b90ecd84e62bdf35b5bef73241726cf57c988cd0a70e64: Status 404 returned error can't find the container with id 43d1bea11ff1be0d13b90ecd84e62bdf35b5bef73241726cf57c988cd0a70e64 Jul 06 19:54:46.660148 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.660078 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c"] Jul 06 19:54:46.663541 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:54:46.663521 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda136fc5b_adc8_4f0f_9fb3_5e02aaca810e.slice/crio-b694ec2ead4d91ee90abae75023d2232bd20182421e279ceaa886e8fe59e1fe0 WatchSource:0}: Error finding container b694ec2ead4d91ee90abae75023d2232bd20182421e279ceaa886e8fe59e1fe0: Status 404 returned error can't find the container with id b694ec2ead4d91ee90abae75023d2232bd20182421e279ceaa886e8fe59e1fe0 Jul 06 19:54:46.767312 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:46.767277 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:46.767471 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:46.767437 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:54:46.767515 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:46.767503 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls podName:3d807a3a-be54-4477-9781-c339d7db2781 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:47.767484356 +0000 UTC m=+271.038238635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xkljv" (UID: "3d807a3a-be54-4477-9781-c339d7db2781") : secret "samples-operator-tls" not found Jul 06 19:54:47.037274 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.037234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" event={"ID":"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e","Type":"ContainerStarted","Data":"b694ec2ead4d91ee90abae75023d2232bd20182421e279ceaa886e8fe59e1fe0"} Jul 06 19:54:47.038401 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.038333 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" event={"ID":"895d20fb-5c6e-42e3-a9e8-9607be369c02","Type":"ContainerStarted","Data":"335815bdde58b4c652405639442938b90b60f1cd17b4f7c95e72b9852b9bc0ed"} Jul 06 19:54:47.039518 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.039492 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" event={"ID":"856d23cb-62b2-4d6e-bcdc-644be7044193","Type":"ContainerStarted","Data":"9efd0db5c280b812c0d4ca60b66fb956e33758335e77e095b3d884dc778fe4ec"} Jul 06 19:54:47.040987 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.040963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" event={"ID":"4db4f879-cc41-44bd-b04a-6ab17070a4c3","Type":"ContainerStarted","Data":"0af630486842e7a1f5b92056cfc4b1e549deb787da769d08b1e3c6bb38fdfcb9"} Jul 06 19:54:47.041081 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.040999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" event={"ID":"4db4f879-cc41-44bd-b04a-6ab17070a4c3","Type":"ContainerStarted","Data":"43d1bea11ff1be0d13b90ecd84e62bdf35b5bef73241726cf57c988cd0a70e64"} Jul 06 19:54:47.042096 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.042073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" event={"ID":"dd4d6d2f-6ab3-4526-860b-96f00868dd9d","Type":"ContainerStarted","Data":"89a9433c3fdbe1bcb39caf5a9c0ce64e889b07c92faf3ed182b3d07a7d5d4782"} Jul 06 19:54:47.060003 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.059957 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-djpx9" podStartSLOduration=1.059942996 podStartE2EDuration="1.059942996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:47.059149373 +0000 UTC m=+270.329903683" watchObservedRunningTime="2026-07-06 19:54:47.059942996 +0000 UTC m=+270.330697295" Jul 06 19:54:47.776536 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:47.776490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:47.776765 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:47.776686 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:54:47.776765 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:47.776764 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls podName:3d807a3a-be54-4477-9781-c339d7db2781 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:49.776743508 +0000 UTC m=+273.047497791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xkljv" (UID: "3d807a3a-be54-4477-9781-c339d7db2781") : secret "samples-operator-tls" not found Jul 06 19:54:48.046798 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:48.046683 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" event={"ID":"856d23cb-62b2-4d6e-bcdc-644be7044193","Type":"ContainerStarted","Data":"01eb9bbf70b3516194b034b4ee17885f582375629eb28c4bb47cec97d0edb935"} Jul 06 19:54:48.062662 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:48.062589 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hmgck" podStartSLOduration=0.733285698 podStartE2EDuration="2.062568379s" totalImagesPullingTime="1.329282681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:48.062046552 +0000 UTC m=+271.332800853" watchObservedRunningTime="2026-07-06 19:54:48.062568379 +0000 UTC m=+271.333322681" Jul 06 19:54:49.794890 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:49.794864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:49.795156 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:49.795013 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:54:49.795156 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:49.795079 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls podName:3d807a3a-be54-4477-9781-c339d7db2781 nodeName:}" failed. No retries permitted until 2026-07-06 19:54:53.795062406 +0000 UTC m=+277.065816700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xkljv" (UID: "3d807a3a-be54-4477-9781-c339d7db2781") : secret "samples-operator-tls" not found Jul 06 19:54:50.055015 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.054913 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" event={"ID":"dd4d6d2f-6ab3-4526-860b-96f00868dd9d","Type":"ContainerStarted","Data":"6979a7720ea1b7b7bbf3a9ebb84f4e29b6cd9c8cbc6d9ac2e0b7a29602327e45"} Jul 06 19:54:50.056406 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.056377 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" event={"ID":"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e","Type":"ContainerStarted","Data":"fa6646c4bc2bd9e84b01c1415e568099ad05fec46de27cbf3a528cf82a22abd2"} Jul 06 19:54:50.057957 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.057938 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/0.log" Jul 06 19:54:50.058035 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.057976 2558 generic.go:356] "Generic (PLEG): container finished" podID="895d20fb-5c6e-42e3-a9e8-9607be369c02" containerID="64ad917892668bb662fe5678fe95e2afc46518d621760c9dafb1d5c1286af30d" exitCode=255 Jul 06 19:54:50.058035 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.058016 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" event={"ID":"895d20fb-5c6e-42e3-a9e8-9607be369c02","Type":"ContainerDied","Data":"64ad917892668bb662fe5678fe95e2afc46518d621760c9dafb1d5c1286af30d"} Jul 06 19:54:50.058233 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.058220 2558 scope.go:117] "RemoveContainer" containerID="64ad917892668bb662fe5678fe95e2afc46518d621760c9dafb1d5c1286af30d" Jul 06 19:54:50.073697 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.073415 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" podStartSLOduration=0.908298896 podStartE2EDuration="4.073398644s" totalImagesPullingTime="3.165099748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:50.073180206 +0000 UTC m=+273.343934522" watchObservedRunningTime="2026-07-06 19:54:50.073398644 +0000 UTC m=+273.344152945" Jul 06 19:54:50.108346 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.108299 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" podStartSLOduration=1.010058773 podStartE2EDuration="4.108277283s" totalImagesPullingTime="3.09821851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:50.107328701 +0000 UTC m=+273.378083002" watchObservedRunningTime="2026-07-06 19:54:50.108277283 +0000 UTC m=+273.379031585" Jul 06 19:54:50.752398 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.751087 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nsxm6"] Jul 06 19:54:50.753720 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.753677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.757192 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.757164 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:54:50.757319 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.757218 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:54:50.757904 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.757885 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lpwlh\"" Jul 06 19:54:50.767612 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.767591 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsxm6"] Jul 06 19:54:50.802703 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.802674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.803098 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.802728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597tr\" (UniqueName: \"kubernetes.io/projected/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-api-access-597tr\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.803098 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.802755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47ee727d-d64c-45f8-b88d-768f4b9d200a-crio-socket\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.803098 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.802831 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.803098 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.802874 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ee727d-d64c-45f8-b88d-768f4b9d200a-data-volume\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.903927 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.903883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ee727d-d64c-45f8-b88d-768f4b9d200a-data-volume\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.904115 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.903952 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.904115 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.903982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597tr\" (UniqueName: \"kubernetes.io/projected/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-api-access-597tr\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.904115 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.903998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47ee727d-d64c-45f8-b88d-768f4b9d200a-crio-socket\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.904115 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.904030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.904115 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:50.904044 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:54:50.904115 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:50.904095 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:54:50.904410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.904117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/47ee727d-d64c-45f8-b88d-768f4b9d200a-crio-socket\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.904410 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:50.904134 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:51.404113302 +0000 UTC m=+274.674867602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : secret "insights-runtime-extractor-tls" not found Jul 06 19:54:50.904410 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:50.904151 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:51.404142974 +0000 UTC m=+274.674897253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : configmap "kube-rbac-proxy" not found Jul 06 19:54:50.904410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.904324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/47ee727d-d64c-45f8-b88d-768f4b9d200a-data-volume\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:50.912621 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:50.912596 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-597tr\" (UniqueName: \"kubernetes.io/projected/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-api-access-597tr\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:51.062207 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.062131 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/1.log" Jul 06 19:54:51.062527 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.062514 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/0.log" Jul 06 19:54:51.062582 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.062551 2558 generic.go:356] "Generic (PLEG): container finished" podID="895d20fb-5c6e-42e3-a9e8-9607be369c02" containerID="702fc64cefbcaa23871fbde130e2f3146d0fa013bbdf5e17625009a52f489c6c" exitCode=255 Jul 06 19:54:51.062665 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.062624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" event={"ID":"895d20fb-5c6e-42e3-a9e8-9607be369c02","Type":"ContainerDied","Data":"702fc64cefbcaa23871fbde130e2f3146d0fa013bbdf5e17625009a52f489c6c"} Jul 06 19:54:51.062728 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.062699 2558 scope.go:117] "RemoveContainer" containerID="64ad917892668bb662fe5678fe95e2afc46518d621760c9dafb1d5c1286af30d" Jul 06 19:54:51.063318 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.062898 2558 scope.go:117] "RemoveContainer" containerID="702fc64cefbcaa23871fbde130e2f3146d0fa013bbdf5e17625009a52f489c6c" Jul 06 19:54:51.063318 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:51.063098 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nnvn2_openshift-console-operator(895d20fb-5c6e-42e3-a9e8-9607be369c02)\"" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" podUID="895d20fb-5c6e-42e3-a9e8-9607be369c02" Jul 06 19:54:51.408001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.407917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:51.408001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:51.407980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:51.408188 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:51.408057 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:54:51.408188 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:51.408123 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:52.408109215 +0000 UTC m=+275.678863494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : configmap "kube-rbac-proxy" not found Jul 06 19:54:51.408188 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:51.408059 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:54:51.408188 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:51.408190 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:52.408182149 +0000 UTC m=+275.678936427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : secret "insights-runtime-extractor-tls" not found Jul 06 19:54:52.066859 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.066830 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/1.log" Jul 06 19:54:52.067238 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.067147 2558 scope.go:117] "RemoveContainer" containerID="702fc64cefbcaa23871fbde130e2f3146d0fa013bbdf5e17625009a52f489c6c" Jul 06 19:54:52.067315 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:52.067296 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nnvn2_openshift-console-operator(895d20fb-5c6e-42e3-a9e8-9607be369c02)\"" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" podUID="895d20fb-5c6e-42e3-a9e8-9607be369c02" Jul 06 19:54:52.384909 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.384828 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt"] Jul 06 19:54:52.387709 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.387693 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" Jul 06 19:54:52.390168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.390151 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 19:54:52.390303 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.390285 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 19:54:52.390345 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.390285 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-kxvg9\"" Jul 06 19:54:52.397181 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.397161 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt"] Jul 06 19:54:52.418110 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.418085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:52.418219 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.418161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:52.418219 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:52.418205 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:54:52.418337 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:52.418275 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:54.41825405 +0000 UTC m=+277.689008328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : configmap "kube-rbac-proxy" not found Jul 06 19:54:52.418337 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:52.418301 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:54:52.418432 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:52.418342 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:54.418328903 +0000 UTC m=+277.689083181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : secret "insights-runtime-extractor-tls" not found Jul 06 19:54:52.518690 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.518661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4mnp\" (UniqueName: \"kubernetes.io/projected/fa8a8447-8549-4909-b062-e1d66418e955-kube-api-access-z4mnp\") pod \"migrator-d57d58cc9-bplqt\" (UID: \"fa8a8447-8549-4909-b062-e1d66418e955\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" Jul 06 19:54:52.619815 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.619776 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4mnp\" (UniqueName: \"kubernetes.io/projected/fa8a8447-8549-4909-b062-e1d66418e955-kube-api-access-z4mnp\") pod \"migrator-d57d58cc9-bplqt\" (UID: \"fa8a8447-8549-4909-b062-e1d66418e955\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" Jul 06 19:54:52.627548 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.627528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4mnp\" (UniqueName: \"kubernetes.io/projected/fa8a8447-8549-4909-b062-e1d66418e955-kube-api-access-z4mnp\") pod \"migrator-d57d58cc9-bplqt\" (UID: \"fa8a8447-8549-4909-b062-e1d66418e955\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" Jul 06 19:54:52.696205 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.696168 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" Jul 06 19:54:52.813371 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.813340 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt"] Jul 06 19:54:52.816002 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:54:52.815978 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8a8447_8549_4909_b062_e1d66418e955.slice/crio-7d0da477d77d40b02db386a14fde06d7f578b11fd8c955ac799b8bf54e37865b WatchSource:0}: Error finding container 7d0da477d77d40b02db386a14fde06d7f578b11fd8c955ac799b8bf54e37865b: Status 404 returned error can't find the container with id 7d0da477d77d40b02db386a14fde06d7f578b11fd8c955ac799b8bf54e37865b Jul 06 19:54:52.936577 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.936553 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzcpb_a795b245-ceba-469b-b542-be1f1c8d074f/dns-node-resolver/0.log" Jul 06 19:54:52.998891 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:52.998816 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n82b2"] Jul 06 19:54:53.001419 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.001405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.004066 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.004047 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-b6d67\"" Jul 06 19:54:53.004181 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.004094 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 19:54:53.004181 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.004100 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 19:54:53.004181 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.004046 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 19:54:53.004315 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.004204 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 19:54:53.010208 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.010188 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n82b2"] Jul 06 19:54:53.070541 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.070510 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" event={"ID":"fa8a8447-8549-4909-b062-e1d66418e955","Type":"ContainerStarted","Data":"7d0da477d77d40b02db386a14fde06d7f578b11fd8c955ac799b8bf54e37865b"} Jul 06 19:54:53.124335 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.124307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7w5w\" (UniqueName: \"kubernetes.io/projected/e63ea952-7777-4503-b883-1d591e493f14-kube-api-access-d7w5w\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.124486 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.124361 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e63ea952-7777-4503-b883-1d591e493f14-signing-cabundle\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.124527 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.124491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e63ea952-7777-4503-b883-1d591e493f14-signing-key\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.225590 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.225557 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e63ea952-7777-4503-b883-1d591e493f14-signing-key\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.225751 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.225600 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7w5w\" (UniqueName: \"kubernetes.io/projected/e63ea952-7777-4503-b883-1d591e493f14-kube-api-access-d7w5w\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.225794 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.225749 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e63ea952-7777-4503-b883-1d591e493f14-signing-cabundle\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.226367 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.226350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e63ea952-7777-4503-b883-1d591e493f14-signing-cabundle\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.227990 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.227971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e63ea952-7777-4503-b883-1d591e493f14-signing-key\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.233584 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.233559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7w5w\" (UniqueName: \"kubernetes.io/projected/e63ea952-7777-4503-b883-1d591e493f14-kube-api-access-d7w5w\") pod \"service-ca-758f599c5-n82b2\" (UID: \"e63ea952-7777-4503-b883-1d591e493f14\") " pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.310577 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.310489 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n82b2" Jul 06 19:54:53.426302 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.426266 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n82b2"] Jul 06 19:54:53.429594 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:54:53.429571 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63ea952_7777_4503_b883_1d591e493f14.slice/crio-58853931aee8728877662e06c18064873969044005f4c8a9396ee9f96725e3b6 WatchSource:0}: Error finding container 58853931aee8728877662e06c18064873969044005f4c8a9396ee9f96725e3b6: Status 404 returned error can't find the container with id 58853931aee8728877662e06c18064873969044005f4c8a9396ee9f96725e3b6 Jul 06 19:54:53.735338 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.735315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5468s_89ade938-bfc4-413e-a75b-60e8c08c3c68/node-ca/0.log" Jul 06 19:54:53.830185 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:53.830146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:54:53.830362 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:53.830290 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 19:54:53.830362 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:53.830347 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls podName:3d807a3a-be54-4477-9781-c339d7db2781 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:01.83033172 +0000 UTC m=+285.101086003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-xkljv" (UID: "3d807a3a-be54-4477-9781-c339d7db2781") : secret "samples-operator-tls" not found Jul 06 19:54:54.074695 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:54.074608 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n82b2" event={"ID":"e63ea952-7777-4503-b883-1d591e493f14","Type":"ContainerStarted","Data":"58853931aee8728877662e06c18064873969044005f4c8a9396ee9f96725e3b6"} Jul 06 19:54:54.336162 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:54.336092 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5shln_90fab817-e894-4238-ba9a-d1bbb9e27fd9/serve-healthcheck-canary/0.log" Jul 06 19:54:54.436294 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:54.436257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:54.436425 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:54.436330 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:54.436425 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:54.436402 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:54:54.436425 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:54.436408 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:54:54.436527 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:54.436461 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:58.436448068 +0000 UTC m=+281.707202468 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : secret "insights-runtime-extractor-tls" not found Jul 06 19:54:54.436527 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:54.436478 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:54:58.436470989 +0000 UTC m=+281.707225267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : configmap "kube-rbac-proxy" not found Jul 06 19:54:55.079953 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:55.079904 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" event={"ID":"fa8a8447-8549-4909-b062-e1d66418e955","Type":"ContainerStarted","Data":"61b4cba20938aa0272223f9509a3fbbbf6ab48fa253104504c7bc7f4e7623794"} Jul 06 19:54:55.080395 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:55.079966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" event={"ID":"fa8a8447-8549-4909-b062-e1d66418e955","Type":"ContainerStarted","Data":"f0003462f090970e3dd8e124a41a748f734de28df9cb40fd29e85b09d6d13bbd"} Jul 06 19:54:55.097531 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:55.097469 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bplqt" podStartSLOduration=1.690768896 podStartE2EDuration="3.097451253s" totalImagesPullingTime="1.406682357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:55.095695747 +0000 UTC m=+278.366450048" watchObservedRunningTime="2026-07-06 19:54:55.097451253 +0000 UTC m=+278.368205553" Jul 06 19:54:56.084187 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:56.084152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n82b2" event={"ID":"e63ea952-7777-4503-b883-1d591e493f14","Type":"ContainerStarted","Data":"6998846bd0aa7209c04bdc0d5b86984adc97d69e66e7bef945a3eee0be3834e4"} Jul 06 19:54:56.106097 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:56.106049 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-n82b2" podStartSLOduration=2.208328176 podStartE2EDuration="4.106034807s" totalImagesPullingTime="1.897706631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:54:56.099845073 +0000 UTC m=+279.370599372" watchObservedRunningTime="2026-07-06 19:54:56.106034807 +0000 UTC m=+279.376789132" Jul 06 19:54:56.365828 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:56.365745 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:56.365828 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:56.365824 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:54:56.366151 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:56.366139 2558 scope.go:117] "RemoveContainer" containerID="702fc64cefbcaa23871fbde130e2f3146d0fa013bbdf5e17625009a52f489c6c" Jul 06 19:54:56.366296 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:56.366279 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-nnvn2_openshift-console-operator(895d20fb-5c6e-42e3-a9e8-9607be369c02)\"" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" podUID="895d20fb-5c6e-42e3-a9e8-9607be369c02" Jul 06 19:54:58.469090 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:58.469055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:58.469562 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:54:58.469128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:54:58.469562 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:58.469233 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:54:58.469562 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:58.469264 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:54:58.469562 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:58.469295 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:55:06.469278848 +0000 UTC m=+289.740033129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : secret "insights-runtime-extractor-tls" not found Jul 06 19:54:58.469562 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:58.469315 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:55:06.469302159 +0000 UTC m=+289.740056437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : configmap "kube-rbac-proxy" not found Jul 06 19:54:59.780955 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:54:59.780919 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" podUID="adabb4c7-ecfe-4204-bace-10996203e1f1" Jul 06 19:55:00.097617 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:00.097549 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:55:01.898762 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:01.898725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:55:01.901039 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:01.901013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3d807a3a-be54-4477-9781-c339d7db2781-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-xkljv\" (UID: \"3d807a3a-be54-4477-9781-c339d7db2781\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:55:01.960094 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:01.960053 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" Jul 06 19:55:02.085892 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:02.085862 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv"] Jul 06 19:55:03.007341 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.007306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:55:03.007713 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:03.007439 2558 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 06 19:55:03.007713 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:03.007496 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert podName:adabb4c7-ecfe-4204-bace-10996203e1f1 nodeName:}" failed. No retries permitted until 2026-07-06 19:57:05.007479471 +0000 UTC m=+408.278233767 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-9qjlv" (UID: "adabb4c7-ecfe-4204-bace-10996203e1f1") : secret "networking-console-plugin-cert" not found Jul 06 19:55:03.106960 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.106922 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" event={"ID":"3d807a3a-be54-4477-9781-c339d7db2781","Type":"ContainerStarted","Data":"ecb737e4e7ca38cf3ee9394469434e0f903826cfa6771ee762f2f95eb9aca61a"} Jul 06 19:55:03.108187 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.108169 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:55:03.108272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.108213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:55:03.110480 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.110459 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b82780f1-a844-499d-940a-af73bda34e50-metrics-tls\") pod \"dns-default-b9x86\" (UID: \"b82780f1-a844-499d-940a-af73bda34e50\") " pod="openshift-dns/dns-default-b9x86" Jul 06 19:55:03.110615 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.110598 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"image-registry-8d66dd7c6-2c2th\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:55:03.317566 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.317488 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45vdg\"" Jul 06 19:55:03.317741 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.317623 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s7fls\"" Jul 06 19:55:03.325799 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.325776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b9x86" Jul 06 19:55:03.325949 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.325816 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:55:03.474466 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.474431 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b9x86"] Jul 06 19:55:03.478365 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:03.478336 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82780f1_a844_499d_940a_af73bda34e50.slice/crio-0d95cbd24ccc82c51e2f0fa2a904847b27ca3d5fd1a2e298e4c0e83ec772555b WatchSource:0}: Error finding container 0d95cbd24ccc82c51e2f0fa2a904847b27ca3d5fd1a2e298e4c0e83ec772555b: Status 404 returned error can't find the container with id 0d95cbd24ccc82c51e2f0fa2a904847b27ca3d5fd1a2e298e4c0e83ec772555b Jul 06 19:55:03.494294 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:03.494269 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8d66dd7c6-2c2th"] Jul 06 19:55:03.497809 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:03.497782 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdaa6929_3ff9_4a46_ad30_ca2a8962f509.slice/crio-799e8aae5e011fd77693af24de268e1d9cfae0bd3387668a28051968fc92648d WatchSource:0}: Error finding container 799e8aae5e011fd77693af24de268e1d9cfae0bd3387668a28051968fc92648d: Status 404 returned error can't find the container with id 799e8aae5e011fd77693af24de268e1d9cfae0bd3387668a28051968fc92648d Jul 06 19:55:04.112592 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:04.112557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" event={"ID":"bdaa6929-3ff9-4a46-ad30-ca2a8962f509","Type":"ContainerStarted","Data":"67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3"} Jul 06 19:55:04.113060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:04.112613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" event={"ID":"bdaa6929-3ff9-4a46-ad30-ca2a8962f509","Type":"ContainerStarted","Data":"799e8aae5e011fd77693af24de268e1d9cfae0bd3387668a28051968fc92648d"} Jul 06 19:55:04.113060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:04.112744 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:55:04.114483 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:04.114452 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9x86" event={"ID":"b82780f1-a844-499d-940a-af73bda34e50","Type":"ContainerStarted","Data":"0d95cbd24ccc82c51e2f0fa2a904847b27ca3d5fd1a2e298e4c0e83ec772555b"} Jul 06 19:55:04.136733 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:04.136691 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" podStartSLOduration=286.136671458 podStartE2EDuration="4m46.136671458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:04.134916098 +0000 UTC m=+287.405670401" watchObservedRunningTime="2026-07-06 19:55:04.136671458 +0000 UTC m=+287.407425757" Jul 06 19:55:05.119916 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:05.119885 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" event={"ID":"3d807a3a-be54-4477-9781-c339d7db2781","Type":"ContainerStarted","Data":"a5ac95643a0ce31623f844b4ae6da45e8ddf8c825ac2ecad0c60324be1cc62d5"} Jul 06 19:55:05.120343 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:05.119940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" event={"ID":"3d807a3a-be54-4477-9781-c339d7db2781","Type":"ContainerStarted","Data":"3a498216c355ff9e8e06d2423f5ff47e3091827d831c7a977f5a14fb2e74050d"} Jul 06 19:55:05.139327 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:05.139282 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-xkljv" podStartSLOduration=16.808490134 podStartE2EDuration="19.13926664s" totalImagesPullingTime="2.330776506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:05.138537497 +0000 UTC m=+288.409291798" watchObservedRunningTime="2026-07-06 19:55:05.13926664 +0000 UTC m=+288.410020989" Jul 06 19:55:06.124946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:06.124908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9x86" event={"ID":"b82780f1-a844-499d-940a-af73bda34e50","Type":"ContainerStarted","Data":"e13802b641396e6a478dbb5bad4921f586a295afeee31f5111a784b2840bf4b3"} Jul 06 19:55:06.125342 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:06.125193 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b9x86" Jul 06 19:55:06.125342 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:06.125229 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b9x86" event={"ID":"b82780f1-a844-499d-940a-af73bda34e50","Type":"ContainerStarted","Data":"18109448c921eb984defaae29710f1b8af6b1a32aebb7441d7dc1abfcbdadb34"} Jul 06 19:55:06.142357 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:06.142322 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b9x86" podStartSLOduration=252.294715968 podStartE2EDuration="4m14.142310817s" totalImagesPullingTime="1.847594849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:06.142237245 +0000 UTC m=+289.412991545" watchObservedRunningTime="2026-07-06 19:55:06.142310817 +0000 UTC m=+289.413065116" Jul 06 19:55:06.539383 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:06.539349 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:55:06.539575 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:06.539421 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:55:06.539575 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:06.539504 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:55:06.539575 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:06.539566 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls podName:47ee727d-d64c-45f8-b88d-768f4b9d200a nodeName:}" failed. No retries permitted until 2026-07-06 19:55:22.539550212 +0000 UTC m=+305.810304501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nsxm6" (UID: "47ee727d-d64c-45f8-b88d-768f4b9d200a") : secret "insights-runtime-extractor-tls" not found Jul 06 19:55:06.540064 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:06.540038 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/47ee727d-d64c-45f8-b88d-768f4b9d200a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:55:09.314234 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:09.314197 2558 scope.go:117] "RemoveContainer" containerID="702fc64cefbcaa23871fbde130e2f3146d0fa013bbdf5e17625009a52f489c6c" Jul 06 19:55:10.138604 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:10.138579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 19:55:10.139003 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:10.138979 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/1.log" Jul 06 19:55:10.139065 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:10.139020 2558 generic.go:356] "Generic (PLEG): container finished" podID="895d20fb-5c6e-42e3-a9e8-9607be369c02" containerID="42dba8701918a6d81096a4f180a28c3a1b239cbed63add2cc9b11578875213fc" exitCode=255 Jul 06 19:55:10.139108 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:10.139062 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" event={"ID":"895d20fb-5c6e-42e3-a9e8-9607be369c02","Type":"ContainerDied","Data":"42dba8701918a6d81096a4f180a28c3a1b239cbed63add2cc9b11578875213fc"} Jul 06 19:55:10.139151 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:10.139109 2558 scope.go:117] "RemoveContainer" containerID="702fc64cefbcaa23871fbde130e2f3146d0fa013bbdf5e17625009a52f489c6c" Jul 06 19:55:10.139468 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:10.139441 2558 scope.go:117] "RemoveContainer" containerID="42dba8701918a6d81096a4f180a28c3a1b239cbed63add2cc9b11578875213fc" Jul 06 19:55:10.139653 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:10.139618 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-nnvn2_openshift-console-operator(895d20fb-5c6e-42e3-a9e8-9607be369c02)\"" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" podUID="895d20fb-5c6e-42e3-a9e8-9607be369c02" Jul 06 19:55:11.143606 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:11.143579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 19:55:15.315188 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:15.315145 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jkhqs" podUID="0728ac1f-e602-41f4-8133-77a0fb7696a7" Jul 06 19:55:16.130526 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:16.130501 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b9x86" Jul 06 19:55:16.365670 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:16.365620 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:55:16.366057 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:16.365694 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:55:16.366057 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:16.365965 2558 scope.go:117] "RemoveContainer" containerID="42dba8701918a6d81096a4f180a28c3a1b239cbed63add2cc9b11578875213fc" Jul 06 19:55:16.366132 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:16.366112 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-nnvn2_openshift-console-operator(895d20fb-5c6e-42e3-a9e8-9607be369c02)\"" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" podUID="895d20fb-5c6e-42e3-a9e8-9607be369c02" Jul 06 19:55:17.117464 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:17.117432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 19:55:17.117693 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:17.117664 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 19:55:17.127661 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:17.127616 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:55:20.782407 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:20.782370 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv"] Jul 06 19:55:20.784301 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:20.784283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" Jul 06 19:55:20.786761 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:20.786738 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 19:55:20.786857 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:20.786766 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-rn6gf\"" Jul 06 19:55:20.797001 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:20.796979 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv"] Jul 06 19:55:20.947074 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:20.947037 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b884a383-b371-421c-9395-bcd35965a9a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-f67tv\" (UID: \"b884a383-b371-421c-9395-bcd35965a9a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" Jul 06 19:55:21.052543 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:21.052314 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b884a383-b371-421c-9395-bcd35965a9a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-f67tv\" (UID: \"b884a383-b371-421c-9395-bcd35965a9a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" Jul 06 19:55:21.055040 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:21.055002 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b884a383-b371-421c-9395-bcd35965a9a6-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-f67tv\" (UID: \"b884a383-b371-421c-9395-bcd35965a9a6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" Jul 06 19:55:21.093316 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:21.093283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" Jul 06 19:55:21.213223 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:21.213191 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv"] Jul 06 19:55:21.216124 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:21.216089 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb884a383_b371_421c_9395_bcd35965a9a6.slice/crio-c95c1630abcd945ed3e1fe00628607de8895b6204951be92530316e6d2761fb0 WatchSource:0}: Error finding container c95c1630abcd945ed3e1fe00628607de8895b6204951be92530316e6d2761fb0: Status 404 returned error can't find the container with id c95c1630abcd945ed3e1fe00628607de8895b6204951be92530316e6d2761fb0 Jul 06 19:55:21.218114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:21.218093 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:55:22.179626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:22.179586 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" event={"ID":"b884a383-b371-421c-9395-bcd35965a9a6","Type":"ContainerStarted","Data":"c95c1630abcd945ed3e1fe00628607de8895b6204951be92530316e6d2761fb0"} Jul 06 19:55:22.564123 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:22.564102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:55:22.566179 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:22.566158 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/47ee727d-d64c-45f8-b88d-768f4b9d200a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nsxm6\" (UID: \"47ee727d-d64c-45f8-b88d-768f4b9d200a\") " pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:55:22.865545 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:22.865460 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lpwlh\"" Jul 06 19:55:22.873721 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:22.873697 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nsxm6" Jul 06 19:55:22.997818 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:22.997791 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nsxm6"] Jul 06 19:55:23.000634 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:23.000612 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ee727d_d64c_45f8_b88d_768f4b9d200a.slice/crio-3e892587558486d19fc196e6edbe901f05303af543cc18e77d239b68fb5a83c5 WatchSource:0}: Error finding container 3e892587558486d19fc196e6edbe901f05303af543cc18e77d239b68fb5a83c5: Status 404 returned error can't find the container with id 3e892587558486d19fc196e6edbe901f05303af543cc18e77d239b68fb5a83c5 Jul 06 19:55:23.183495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:23.183463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" event={"ID":"b884a383-b371-421c-9395-bcd35965a9a6","Type":"ContainerStarted","Data":"59538e5ae611acb53eda3ffaed25337e0105ecaaaa938ddedc18456824be1c54"} Jul 06 19:55:23.183961 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:23.183633 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" Jul 06 19:55:23.184586 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:23.184565 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsxm6" event={"ID":"47ee727d-d64c-45f8-b88d-768f4b9d200a","Type":"ContainerStarted","Data":"3e892587558486d19fc196e6edbe901f05303af543cc18e77d239b68fb5a83c5"} Jul 06 19:55:23.188291 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:23.188265 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" Jul 06 19:55:23.205918 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:23.205881 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-f67tv" podStartSLOduration=1.861972344 podStartE2EDuration="3.205868775s" totalImagesPullingTime="1.343896431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:23.205389195 +0000 UTC m=+306.476143496" watchObservedRunningTime="2026-07-06 19:55:23.205868775 +0000 UTC m=+306.476623074" Jul 06 19:55:23.329689 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:23.329654 2558 patch_prober.go:28] interesting pod/image-registry-8d66dd7c6-2c2th container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 19:55:23.329867 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:23.329706 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" podUID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 19:55:25.124593 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:25.124561 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:55:27.199486 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:27.199452 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsxm6" event={"ID":"47ee727d-d64c-45f8-b88d-768f4b9d200a","Type":"ContainerStarted","Data":"f1524ad247526c71414fa3ec12bc465c1619ea608cd13030f27d1a064fa90165"} Jul 06 19:55:27.315622 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:27.315600 2558 scope.go:117] "RemoveContainer" containerID="42dba8701918a6d81096a4f180a28c3a1b239cbed63add2cc9b11578875213fc" Jul 06 19:55:27.315771 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:27.315750 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-nnvn2_openshift-console-operator(895d20fb-5c6e-42e3-a9e8-9607be369c02)\"" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" podUID="895d20fb-5c6e-42e3-a9e8-9607be369c02" Jul 06 19:55:28.204460 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:28.204418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsxm6" event={"ID":"47ee727d-d64c-45f8-b88d-768f4b9d200a","Type":"ContainerStarted","Data":"9bb7ff2b68abf333b4ebcc229797b63af83084acdc05d2ffe7ebcda2834e0c64"} Jul 06 19:55:28.314366 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:28.314331 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:55:30.214777 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.214704 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nsxm6" event={"ID":"47ee727d-d64c-45f8-b88d-768f4b9d200a","Type":"ContainerStarted","Data":"ba77965e434f2fc2e843086c0ea87fcddcfdbc07466adfc9d3395530c1d90348"} Jul 06 19:55:30.242924 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.242870 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nsxm6" podStartSLOduration=33.65269035 podStartE2EDuration="40.242850228s" totalImagesPullingTime="6.590159878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:54:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:30.241141606 +0000 UTC m=+313.511895907" watchObservedRunningTime="2026-07-06 19:55:30.242850228 +0000 UTC m=+313.513604528" Jul 06 19:55:30.281095 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.281064 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq"] Jul 06 19:55:30.284810 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.284786 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.289459 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.289415 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:55:30.289619 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.289419 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 06 19:55:30.289784 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.289755 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:55:30.289867 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.289852 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:55:30.289916 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.289891 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ssjp9\"" Jul 06 19:55:30.289963 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.289950 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:55:30.305686 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.305662 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq"] Jul 06 19:55:30.317680 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.317654 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wwb88"] Jul 06 19:55:30.321281 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.321264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.324217 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.324045 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-td258\"" Jul 06 19:55:30.324217 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.324100 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:55:30.324373 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.324256 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:55:30.324566 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.324532 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:55:30.326626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.326396 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.326626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.326434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f03f40-9477-417e-af69-957f5fc01a38-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.326626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.326498 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.326626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.326528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqd9d\" (UniqueName: \"kubernetes.io/projected/f0f03f40-9477-417e-af69-957f5fc01a38-kube-api-access-lqd9d\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.427257 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.427257 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f03f40-9477-417e-af69-957f5fc01a38-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427329 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-tls\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427356 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:30.427370 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqd9d\" (UniqueName: \"kubernetes.io/projected/f0f03f40-9477-417e-af69-957f5fc01a38-kube-api-access-lqd9d\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f43b4637-c080-44e2-8654-f44cf0b16ac9-metrics-client-ca\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:30.427431 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-tls podName:f0f03f40-9477-417e-af69-957f5fc01a38 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:30.92741173 +0000 UTC m=+314.198166023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-mscsq" (UID: "f0f03f40-9477-417e-af69-957f5fc01a38") : secret "openshift-state-metrics-tls" not found Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427495 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427495 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dfp7\" (UniqueName: \"kubernetes.io/projected/f43b4637-c080-44e2-8654-f44cf0b16ac9-kube-api-access-4dfp7\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427958 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-wtmp\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427958 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-root\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427958 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-sys\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.427958 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.427602 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-textfile\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.428199 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.428006 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0f03f40-9477-417e-af69-957f5fc01a38-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.429950 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.429928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.444510 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.444486 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqd9d\" (UniqueName: \"kubernetes.io/projected/f0f03f40-9477-417e-af69-957f5fc01a38-kube-api-access-lqd9d\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.528628 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528545 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528628 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528588 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-tls\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528628 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f43b4637-c080-44e2-8654-f44cf0b16ac9-metrics-client-ca\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528885 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528885 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528688 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dfp7\" (UniqueName: \"kubernetes.io/projected/f43b4637-c080-44e2-8654-f44cf0b16ac9-kube-api-access-4dfp7\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528885 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-wtmp\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528885 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-root\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528885 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528799 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-root\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528885 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-sys\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.528885 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-textfile\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.529147 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528877 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-wtmp\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.529147 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.528939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f43b4637-c080-44e2-8654-f44cf0b16ac9-sys\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.529238 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.529188 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-textfile\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.529285 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.529255 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-accelerators-collector-config\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.529285 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.529259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f43b4637-c080-44e2-8654-f44cf0b16ac9-metrics-client-ca\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.531056 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.531029 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.531180 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.531162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f43b4637-c080-44e2-8654-f44cf0b16ac9-node-exporter-tls\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.538990 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.538963 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dfp7\" (UniqueName: \"kubernetes.io/projected/f43b4637-c080-44e2-8654-f44cf0b16ac9-kube-api-access-4dfp7\") pod \"node-exporter-wwb88\" (UID: \"f43b4637-c080-44e2-8654-f44cf0b16ac9\") " pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.630625 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.630597 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wwb88" Jul 06 19:55:30.643533 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:30.643503 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43b4637_c080_44e2_8654_f44cf0b16ac9.slice/crio-26334c95f8752df3abde65e9e098e7f6d2f12b296d5ca118a3e39d156d2ebbae WatchSource:0}: Error finding container 26334c95f8752df3abde65e9e098e7f6d2f12b296d5ca118a3e39d156d2ebbae: Status 404 returned error can't find the container with id 26334c95f8752df3abde65e9e098e7f6d2f12b296d5ca118a3e39d156d2ebbae Jul 06 19:55:30.932436 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.932400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:30.934766 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:30.934745 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f0f03f40-9477-417e-af69-957f5fc01a38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-mscsq\" (UID: \"f0f03f40-9477-417e-af69-957f5fc01a38\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:31.196750 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.196671 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" Jul 06 19:55:31.223608 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.223579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wwb88" event={"ID":"f43b4637-c080-44e2-8654-f44cf0b16ac9","Type":"ContainerStarted","Data":"26334c95f8752df3abde65e9e098e7f6d2f12b296d5ca118a3e39d156d2ebbae"} Jul 06 19:55:31.348394 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.348360 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq"] Jul 06 19:55:31.351751 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:31.351723 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f03f40_9477_417e_af69_957f5fc01a38.slice/crio-7839b1b3feab4f999b72a87cfb2b646eaacc2272ecc5b4c653bf2c4a2a8c293b WatchSource:0}: Error finding container 7839b1b3feab4f999b72a87cfb2b646eaacc2272ecc5b4c653bf2c4a2a8c293b: Status 404 returned error can't find the container with id 7839b1b3feab4f999b72a87cfb2b646eaacc2272ecc5b4c653bf2c4a2a8c293b Jul 06 19:55:31.525704 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.525670 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:55:31.529487 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.529468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.535894 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.535870 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:55:31.535894 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.535884 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:55:31.536060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.535910 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:55:31.536060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.535884 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:55:31.536060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.535962 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:55:31.536060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.535987 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:55:31.536060 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.535885 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:55:31.538317 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.538300 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:55:31.538394 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.538350 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fpqtq\"" Jul 06 19:55:31.540838 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.540823 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:55:31.559856 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.559833 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:55:31.638241 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638412 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638412 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-web-config\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638531 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638531 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-config-volume\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638626 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638796 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638796 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-config-out\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638796 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638911 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638816 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhtnt\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-kube-api-access-rhtnt\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.638911 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.638852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.739591 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.739515 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.739591 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.739552 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-web-config\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.739591 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.739585 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.739851 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.739609 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.739851 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.739661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-config-volume\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.739957 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.739864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.739957 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.739896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740048 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:55:31.740018 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle podName:51f371ea-f697-4201-b8ac-91503290bb21 nodeName:}" failed. No retries permitted until 2026-07-06 19:55:32.240000229 +0000 UTC m=+315.510754507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "51f371ea-f697-4201-b8ac-91503290bb21") : configmap references non-existent config key: ca-bundle.crt Jul 06 19:55:31.740125 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740184 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-config-out\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740238 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740313 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhtnt\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-kube-api-access-rhtnt\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740313 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740259 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740405 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740456 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740436 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.740698 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.740675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.742902 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.742730 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.742902 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.742749 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.742902 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.742818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.743151 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.743027 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.743272 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.743251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-config-volume\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.743324 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.743286 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-config-out\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.743376 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.743350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-web-config\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.743895 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.743878 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.744622 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.744602 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:31.756380 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:31.756357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhtnt\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-kube-api-access-rhtnt\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:32.229412 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.229376 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wwb88" event={"ID":"f43b4637-c080-44e2-8654-f44cf0b16ac9","Type":"ContainerStarted","Data":"bb9ee930c4ed3ba6f9ae65d7b27c8ffc96060a7f37244b06cd483ec22cea24fe"} Jul 06 19:55:32.231187 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.231156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" event={"ID":"f0f03f40-9477-417e-af69-957f5fc01a38","Type":"ContainerStarted","Data":"27643f4f035249934d2ca2aad702a804bc216fea415b06050eebee8247f997c3"} Jul 06 19:55:32.231329 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.231202 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" event={"ID":"f0f03f40-9477-417e-af69-957f5fc01a38","Type":"ContainerStarted","Data":"1187e53054d299e9c2718f33e5fec9d31006b2dc5010452e7253707f824e4004"} Jul 06 19:55:32.231329 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.231220 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" event={"ID":"f0f03f40-9477-417e-af69-957f5fc01a38","Type":"ContainerStarted","Data":"7839b1b3feab4f999b72a87cfb2b646eaacc2272ecc5b4c653bf2c4a2a8c293b"} Jul 06 19:55:32.244410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.244380 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:32.245559 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.245535 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:32.438413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.438371 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:55:32.600074 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:32.600049 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:55:32.739591 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:32.739559 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f371ea_f697_4201_b8ac_91503290bb21.slice/crio-28bea899ae7f5b560fd57fcf2d5284a832c7bd5229756870903689e848d4b044 WatchSource:0}: Error finding container 28bea899ae7f5b560fd57fcf2d5284a832c7bd5229756870903689e848d4b044: Status 404 returned error can't find the container with id 28bea899ae7f5b560fd57fcf2d5284a832c7bd5229756870903689e848d4b044 Jul 06 19:55:33.236581 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:33.236547 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" event={"ID":"f0f03f40-9477-417e-af69-957f5fc01a38","Type":"ContainerStarted","Data":"ec684670229a5a44fd44f6c5f88d7e823ba84e0862c95bf8c02ed4e6d88bebf1"} Jul 06 19:55:33.237872 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:33.237851 2558 generic.go:356] "Generic (PLEG): container finished" podID="f43b4637-c080-44e2-8654-f44cf0b16ac9" containerID="bb9ee930c4ed3ba6f9ae65d7b27c8ffc96060a7f37244b06cd483ec22cea24fe" exitCode=0 Jul 06 19:55:33.237977 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:33.237924 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wwb88" event={"ID":"f43b4637-c080-44e2-8654-f44cf0b16ac9","Type":"ContainerDied","Data":"bb9ee930c4ed3ba6f9ae65d7b27c8ffc96060a7f37244b06cd483ec22cea24fe"} Jul 06 19:55:33.239005 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:33.238985 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerStarted","Data":"28bea899ae7f5b560fd57fcf2d5284a832c7bd5229756870903689e848d4b044"} Jul 06 19:55:33.255896 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:33.255842 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-mscsq" podStartSLOduration=1.940279969 podStartE2EDuration="3.255823471s" totalImagesPullingTime="1.315543502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:33.255062792 +0000 UTC m=+316.525817075" watchObservedRunningTime="2026-07-06 19:55:33.255823471 +0000 UTC m=+316.526577771" Jul 06 19:55:34.244544 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:34.244503 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wwb88" event={"ID":"f43b4637-c080-44e2-8654-f44cf0b16ac9","Type":"ContainerStarted","Data":"7d564efaf197eff7172ffbc5762a203fa236bb6e3c7490b0e74c170d46fd0041"} Jul 06 19:55:34.244932 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:34.244606 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wwb88" event={"ID":"f43b4637-c080-44e2-8654-f44cf0b16ac9","Type":"ContainerStarted","Data":"7e1bab124c3e1fa43e11d0ef2f784acb55bf024f1411fd7cdcff3489c874ed03"} Jul 06 19:55:34.273934 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:34.273884 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wwb88" podStartSLOduration=2.737353636 podStartE2EDuration="4.273864148s" totalImagesPullingTime="1.4724331s" totalInitContainerRuntime="64.077412ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:55:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:34.271932373 +0000 UTC m=+317.542686671" watchObservedRunningTime="2026-07-06 19:55:34.273864148 +0000 UTC m=+317.544618450" Jul 06 19:55:35.249464 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.249434 2558 generic.go:356] "Generic (PLEG): container finished" podID="51f371ea-f697-4201-b8ac-91503290bb21" containerID="4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f" exitCode=0 Jul 06 19:55:35.249948 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.249510 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f"} Jul 06 19:55:35.400214 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.400181 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8d66dd7c6-2c2th"] Jul 06 19:55:35.557069 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.556982 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-58d788f4fb-vjvp6"] Jul 06 19:55:35.560528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.560507 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.565318 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.565298 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 06 19:55:35.565460 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.565443 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-khw9t\"" Jul 06 19:55:35.565528 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.565514 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 06 19:55:35.565800 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.565786 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 06 19:55:35.566075 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.566061 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 06 19:55:35.566340 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.566326 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 06 19:55:35.572258 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572239 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.572347 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572254 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 06 19:55:35.572347 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-metrics-client-ca\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.572422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572356 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-federate-client-tls\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.572422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-serving-certs-ca-bundle\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.572422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572406 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.572511 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-secret-telemeter-client\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.572511 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572469 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwxr\" (UniqueName: \"kubernetes.io/projected/92d48476-b191-4bf8-ba9a-051b049d68e8-kube-api-access-clwxr\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.572511 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.572499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-telemeter-client-tls\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.578570 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.578548 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58d788f4fb-vjvp6"] Jul 06 19:55:35.673893 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.673855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674085 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.673904 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-metrics-client-ca\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674085 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.673981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-federate-client-tls\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674085 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.674013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-serving-certs-ca-bundle\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674085 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.674040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674085 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.674068 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-secret-telemeter-client\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674325 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.674106 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwxr\" (UniqueName: \"kubernetes.io/projected/92d48476-b191-4bf8-ba9a-051b049d68e8-kube-api-access-clwxr\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674325 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.674129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-telemeter-client-tls\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.674827 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.674801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-metrics-client-ca\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.675516 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.675051 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.675516 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.675372 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d48476-b191-4bf8-ba9a-051b049d68e8-serving-certs-ca-bundle\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.676785 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.676759 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-secret-telemeter-client\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.676785 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.676779 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-telemeter-client-tls\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.676935 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.676858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-federate-client-tls\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.676935 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.676861 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d48476-b191-4bf8-ba9a-051b049d68e8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.682228 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.682208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwxr\" (UniqueName: \"kubernetes.io/projected/92d48476-b191-4bf8-ba9a-051b049d68e8-kube-api-access-clwxr\") pod \"telemeter-client-58d788f4fb-vjvp6\" (UID: \"92d48476-b191-4bf8-ba9a-051b049d68e8\") " pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:35.869601 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:35.869522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" Jul 06 19:55:36.025816 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:36.025617 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-58d788f4fb-vjvp6"] Jul 06 19:55:36.028586 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:36.028557 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d48476_b191_4bf8_ba9a_051b049d68e8.slice/crio-6a1f51d9061d49707459d0d7391326d9f61e58ff712bfaf47d8d0a922a7f6f89 WatchSource:0}: Error finding container 6a1f51d9061d49707459d0d7391326d9f61e58ff712bfaf47d8d0a922a7f6f89: Status 404 returned error can't find the container with id 6a1f51d9061d49707459d0d7391326d9f61e58ff712bfaf47d8d0a922a7f6f89 Jul 06 19:55:36.253698 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:36.253665 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" event={"ID":"92d48476-b191-4bf8-ba9a-051b049d68e8","Type":"ContainerStarted","Data":"6a1f51d9061d49707459d0d7391326d9f61e58ff712bfaf47d8d0a922a7f6f89"} Jul 06 19:55:38.265615 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:38.265579 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerStarted","Data":"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b"} Jul 06 19:55:38.265982 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:38.265665 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerStarted","Data":"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba"} Jul 06 19:55:38.265982 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:38.265690 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerStarted","Data":"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f"} Jul 06 19:55:38.265982 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:38.265713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerStarted","Data":"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b"} Jul 06 19:55:38.265982 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:38.265735 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerStarted","Data":"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f"} Jul 06 19:55:39.272131 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:39.272099 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerStarted","Data":"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6"} Jul 06 19:55:39.274076 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:39.274053 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" event={"ID":"92d48476-b191-4bf8-ba9a-051b049d68e8","Type":"ContainerStarted","Data":"7e685a239907b30ee6c825c267ee8960bd7a0b31ef4ec663e62dcc6feea37adc"} Jul 06 19:55:39.274183 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:39.274097 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" event={"ID":"92d48476-b191-4bf8-ba9a-051b049d68e8","Type":"ContainerStarted","Data":"8fdea9115b619189d61a15395769ef41b71364f71dfe3138bc4bb75a13a5961e"} Jul 06 19:55:39.274183 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:39.274118 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" event={"ID":"92d48476-b191-4bf8-ba9a-051b049d68e8","Type":"ContainerStarted","Data":"90c706dd9ae9e2eb13c1e7acd4d019f2c9df83eecaeb0f484be53a94eefb4c5d"} Jul 06 19:55:39.307326 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:39.307282 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.847520029 podStartE2EDuration="8.307267998s" totalImagesPullingTime="4.443685072s" totalInitContainerRuntime="16.062897ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:39.305462505 +0000 UTC m=+322.576216805" watchObservedRunningTime="2026-07-06 19:55:39.307267998 +0000 UTC m=+322.578022297" Jul 06 19:55:39.328150 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:39.328106 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-58d788f4fb-vjvp6" podStartSLOduration=1.8663705940000002 podStartE2EDuration="4.32809285s" totalImagesPullingTime="2.461722256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:39.327116956 +0000 UTC m=+322.597871256" watchObservedRunningTime="2026-07-06 19:55:39.32809285 +0000 UTC m=+322.598847148" Jul 06 19:55:41.314933 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:41.314906 2558 scope.go:117] "RemoveContainer" containerID="42dba8701918a6d81096a4f180a28c3a1b239cbed63add2cc9b11578875213fc" Jul 06 19:55:42.289620 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:42.289591 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 19:55:42.289801 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:42.289661 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" event={"ID":"895d20fb-5c6e-42e3-a9e8-9607be369c02","Type":"ContainerStarted","Data":"2c2d4dc03c457417e0bf0e3a7b6ce6439f4d57fb95e7cf56e22cc68980d9b446"} Jul 06 19:55:42.289946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:42.289928 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:55:42.307682 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:42.307619 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" podStartSLOduration=53.061710926 podStartE2EDuration="56.307605418s" totalImagesPullingTime="3.245894492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:42.305726205 +0000 UTC m=+325.576480505" watchObservedRunningTime="2026-07-06 19:55:42.307605418 +0000 UTC m=+325.578359736" Jul 06 19:55:42.386537 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:42.386510 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-nnvn2" Jul 06 19:55:48.567654 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.567608 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b787c8cc5-2flc9"] Jul 06 19:55:48.572130 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.572114 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.576223 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.576196 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:55:48.576332 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.576233 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:55:48.576332 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.576251 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:55:48.576764 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.576749 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:55:48.576836 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.576753 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:55:48.577291 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.577275 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:55:48.577291 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.577285 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b9gjw\"" Jul 06 19:55:48.577410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.577276 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:55:48.586208 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.586186 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b787c8cc5-2flc9"] Jul 06 19:55:48.687294 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.687264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-oauth-config\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.687440 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.687305 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-serving-cert\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.687440 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.687327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-oauth-serving-cert\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.687440 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.687411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-service-ca\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.687542 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.687442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-console-config\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.687542 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.687502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6b6d\" (UniqueName: \"kubernetes.io/projected/e9553674-79cd-45e3-a611-e982364ff97c-kube-api-access-f6b6d\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.788340 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.788298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-service-ca\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.788340 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.788342 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-console-config\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.788548 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.788387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6b6d\" (UniqueName: \"kubernetes.io/projected/e9553674-79cd-45e3-a611-e982364ff97c-kube-api-access-f6b6d\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.788548 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.788449 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-oauth-config\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.788548 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.788483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-serving-cert\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.788548 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.788511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-oauth-serving-cert\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.789107 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.789077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-console-config\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.789216 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.789147 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-service-ca\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.789216 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.789172 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-oauth-serving-cert\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.790852 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.790834 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-serving-cert\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.790931 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.790860 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-oauth-config\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.797825 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.797804 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6b6d\" (UniqueName: \"kubernetes.io/projected/e9553674-79cd-45e3-a611-e982364ff97c-kube-api-access-f6b6d\") pod \"console-6b787c8cc5-2flc9\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:48.881353 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:48.881259 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:49.028561 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:49.028530 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b787c8cc5-2flc9"] Jul 06 19:55:49.031386 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:55:49.031363 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9553674_79cd_45e3_a611_e982364ff97c.slice/crio-1422fe3fba7a2b3a52c1a73956a8a96d277747ae9e9baa27e051c384b2d0ffaa WatchSource:0}: Error finding container 1422fe3fba7a2b3a52c1a73956a8a96d277747ae9e9baa27e051c384b2d0ffaa: Status 404 returned error can't find the container with id 1422fe3fba7a2b3a52c1a73956a8a96d277747ae9e9baa27e051c384b2d0ffaa Jul 06 19:55:49.320975 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:49.320943 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b787c8cc5-2flc9" event={"ID":"e9553674-79cd-45e3-a611-e982364ff97c","Type":"ContainerStarted","Data":"1422fe3fba7a2b3a52c1a73956a8a96d277747ae9e9baa27e051c384b2d0ffaa"} Jul 06 19:55:53.337360 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:53.337322 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b787c8cc5-2flc9" event={"ID":"e9553674-79cd-45e3-a611-e982364ff97c","Type":"ContainerStarted","Data":"756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7"} Jul 06 19:55:53.357797 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:53.357729 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b787c8cc5-2flc9" podStartSLOduration=2.016123583 podStartE2EDuration="5.357714121s" totalImagesPullingTime="3.341590538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:53.356789346 +0000 UTC m=+336.627543647" watchObservedRunningTime="2026-07-06 19:55:53.357714121 +0000 UTC m=+336.628468420" Jul 06 19:55:56.348169 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:56.348084 2558 generic.go:356] "Generic (PLEG): container finished" podID="a136fc5b-adc8-4f0f-9fb3-5e02aaca810e" containerID="fa6646c4bc2bd9e84b01c1415e568099ad05fec46de27cbf3a528cf82a22abd2" exitCode=0 Jul 06 19:55:56.348169 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:56.348156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" event={"ID":"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e","Type":"ContainerDied","Data":"fa6646c4bc2bd9e84b01c1415e568099ad05fec46de27cbf3a528cf82a22abd2"} Jul 06 19:55:56.348555 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:56.348482 2558 scope.go:117] "RemoveContainer" containerID="fa6646c4bc2bd9e84b01c1415e568099ad05fec46de27cbf3a528cf82a22abd2" Jul 06 19:55:57.354518 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:57.354483 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-ndn9c" event={"ID":"a136fc5b-adc8-4f0f-9fb3-5e02aaca810e","Type":"ContainerStarted","Data":"37dadbb5ce66aac786df6d451838bda951682cc6f76d45c83dc2eac40e74a901"} Jul 06 19:55:58.881555 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:58.881511 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:58.881990 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:58.881583 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:58.886278 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:58.886254 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:55:59.366073 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:55:59.366047 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:56:00.419595 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:00.419551 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" podUID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" containerName="registry" containerID="cri-o://67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3" gracePeriod=30 Jul 06 19:56:01.158742 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.158719 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:56:01.304215 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304128 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-installation-pull-secrets\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304215 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304172 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbqtk\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-kube-api-access-pbqtk\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304215 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304193 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304459 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304232 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-ca-trust-extracted\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304459 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304279 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-bound-sa-token\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304459 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304328 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-image-registry-private-configuration\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304459 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304361 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-certificates\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304459 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304387 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-trusted-ca\") pod \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\" (UID: \"bdaa6929-3ff9-4a46-ad30-ca2a8962f509\") " Jul 06 19:56:01.304878 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.304845 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:01.305441 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.305406 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:01.305845 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.305822 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-certificates\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:01.305955 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.305848 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-trusted-ca\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:01.306922 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.306888 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:01.307004 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.306924 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:01.307070 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.307007 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:01.307070 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.307032 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:01.307150 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.307087 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-kube-api-access-pbqtk" (OuterVolumeSpecName: "kube-api-access-pbqtk") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "kube-api-access-pbqtk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:01.314221 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.314189 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "bdaa6929-3ff9-4a46-ad30-ca2a8962f509" (UID: "bdaa6929-3ff9-4a46-ad30-ca2a8962f509"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:01.371235 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.371205 2558 generic.go:356] "Generic (PLEG): container finished" podID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" containerID="67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3" exitCode=0 Jul 06 19:56:01.371402 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.371249 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" Jul 06 19:56:01.371402 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.371290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" event={"ID":"bdaa6929-3ff9-4a46-ad30-ca2a8962f509","Type":"ContainerDied","Data":"67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3"} Jul 06 19:56:01.371402 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.371337 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8d66dd7c6-2c2th" event={"ID":"bdaa6929-3ff9-4a46-ad30-ca2a8962f509","Type":"ContainerDied","Data":"799e8aae5e011fd77693af24de268e1d9cfae0bd3387668a28051968fc92648d"} Jul 06 19:56:01.371402 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.371356 2558 scope.go:117] "RemoveContainer" containerID="67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3" Jul 06 19:56:01.379882 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.379864 2558 scope.go:117] "RemoveContainer" containerID="67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3" Jul 06 19:56:01.380155 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:01.380134 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3\": container with ID starting with 67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3 not found: ID does not exist" containerID="67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3" Jul 06 19:56:01.380224 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.380163 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3"} err="failed to get container status \"67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3\": rpc error: code = NotFound desc = could not find container \"67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3\": container with ID starting with 67d569c463514baecf8f91adaae5af1b59d43a0c44a6a4d6c139d9d8adc7abb3 not found: ID does not exist" Jul 06 19:56:01.388782 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.388761 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8d66dd7c6-2c2th"] Jul 06 19:56:01.392512 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.392489 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8d66dd7c6-2c2th"] Jul 06 19:56:01.406559 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.406529 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-installation-pull-secrets\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:01.406559 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.406552 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbqtk\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-kube-api-access-pbqtk\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:01.406559 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.406563 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-registry-tls\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:01.406766 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.406571 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-ca-trust-extracted\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:01.406766 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.406580 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-bound-sa-token\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:01.406766 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:01.406588 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bdaa6929-3ff9-4a46-ad30-ca2a8962f509-image-registry-private-configuration\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:03.319285 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:03.319252 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" path="/var/lib/kubelet/pods/bdaa6929-3ff9-4a46-ad30-ca2a8962f509/volumes" Jul 06 19:56:07.065094 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:07.065057 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b787c8cc5-2flc9"] Jul 06 19:56:20.442828 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:20.442795 2558 generic.go:356] "Generic (PLEG): container finished" podID="dd4d6d2f-6ab3-4526-860b-96f00868dd9d" containerID="6979a7720ea1b7b7bbf3a9ebb84f4e29b6cd9c8cbc6d9ac2e0b7a29602327e45" exitCode=0 Jul 06 19:56:20.443236 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:20.442842 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" event={"ID":"dd4d6d2f-6ab3-4526-860b-96f00868dd9d","Type":"ContainerDied","Data":"6979a7720ea1b7b7bbf3a9ebb84f4e29b6cd9c8cbc6d9ac2e0b7a29602327e45"} Jul 06 19:56:20.443236 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:20.443152 2558 scope.go:117] "RemoveContainer" containerID="6979a7720ea1b7b7bbf3a9ebb84f4e29b6cd9c8cbc6d9ac2e0b7a29602327e45" Jul 06 19:56:21.448150 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:21.448116 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-s48wt" event={"ID":"dd4d6d2f-6ab3-4526-860b-96f00868dd9d","Type":"ContainerStarted","Data":"087c18b0fa36650a0033df32bc595c4f86ab65210bd74cb1aabeb12c35185a6b"} Jul 06 19:56:31.053479 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:31.053431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:56:31.055660 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:31.055621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0728ac1f-e602-41f4-8133-77a0fb7696a7-metrics-certs\") pod \"network-metrics-daemon-jkhqs\" (UID: \"0728ac1f-e602-41f4-8133-77a0fb7696a7\") " pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:56:31.317529 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:31.317435 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2fwrm\"" Jul 06 19:56:31.325463 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:31.325440 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jkhqs" Jul 06 19:56:31.481120 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:31.481085 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jkhqs"] Jul 06 19:56:31.484018 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:56:31.483990 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0728ac1f_e602_41f4_8133_77a0fb7696a7.slice/crio-0aaae8b8ebb17acc5084a496a34d37eda8d21526154be36a6251ac50f9628047 WatchSource:0}: Error finding container 0aaae8b8ebb17acc5084a496a34d37eda8d21526154be36a6251ac50f9628047: Status 404 returned error can't find the container with id 0aaae8b8ebb17acc5084a496a34d37eda8d21526154be36a6251ac50f9628047 Jul 06 19:56:32.085004 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.084961 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b787c8cc5-2flc9" podUID="e9553674-79cd-45e3-a611-e982364ff97c" containerName="console" containerID="cri-o://756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7" gracePeriod=15 Jul 06 19:56:32.488258 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.488235 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:56:32.490376 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.490349 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkhqs" event={"ID":"0728ac1f-e602-41f4-8133-77a0fb7696a7","Type":"ContainerStarted","Data":"0aaae8b8ebb17acc5084a496a34d37eda8d21526154be36a6251ac50f9628047"} Jul 06 19:56:32.491443 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.491419 2558 generic.go:356] "Generic (PLEG): container finished" podID="e9553674-79cd-45e3-a611-e982364ff97c" containerID="756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7" exitCode=0 Jul 06 19:56:32.491658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.491467 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b787c8cc5-2flc9" Jul 06 19:56:32.491658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.491468 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b787c8cc5-2flc9" event={"ID":"e9553674-79cd-45e3-a611-e982364ff97c","Type":"ContainerDied","Data":"756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7"} Jul 06 19:56:32.491658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.491584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b787c8cc5-2flc9" event={"ID":"e9553674-79cd-45e3-a611-e982364ff97c","Type":"ContainerDied","Data":"1422fe3fba7a2b3a52c1a73956a8a96d277747ae9e9baa27e051c384b2d0ffaa"} Jul 06 19:56:32.491658 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.491602 2558 scope.go:117] "RemoveContainer" containerID="756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7" Jul 06 19:56:32.504225 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.504208 2558 scope.go:117] "RemoveContainer" containerID="756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7" Jul 06 19:56:32.504497 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:32.504472 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7\": container with ID starting with 756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7 not found: ID does not exist" containerID="756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7" Jul 06 19:56:32.504600 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.504501 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7"} err="failed to get container status \"756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7\": rpc error: code = NotFound desc = could not find container \"756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7\": container with ID starting with 756bff0ce7a83ea7eb02d8e49fe33964262bf5153c7bfc75571868485d329df7 not found: ID does not exist" Jul 06 19:56:32.567410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567382 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-serving-cert\") pod \"e9553674-79cd-45e3-a611-e982364ff97c\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " Jul 06 19:56:32.567410 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567412 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-service-ca\") pod \"e9553674-79cd-45e3-a611-e982364ff97c\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " Jul 06 19:56:32.567588 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567433 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6b6d\" (UniqueName: \"kubernetes.io/projected/e9553674-79cd-45e3-a611-e982364ff97c-kube-api-access-f6b6d\") pod \"e9553674-79cd-45e3-a611-e982364ff97c\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " Jul 06 19:56:32.567588 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567458 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-console-config\") pod \"e9553674-79cd-45e3-a611-e982364ff97c\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " Jul 06 19:56:32.567588 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567489 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-oauth-config\") pod \"e9553674-79cd-45e3-a611-e982364ff97c\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " Jul 06 19:56:32.567588 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567521 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-oauth-serving-cert\") pod \"e9553674-79cd-45e3-a611-e982364ff97c\" (UID: \"e9553674-79cd-45e3-a611-e982364ff97c\") " Jul 06 19:56:32.567847 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567817 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-service-ca" (OuterVolumeSpecName: "service-ca") pod "e9553674-79cd-45e3-a611-e982364ff97c" (UID: "e9553674-79cd-45e3-a611-e982364ff97c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:32.567952 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567903 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-console-config" (OuterVolumeSpecName: "console-config") pod "e9553674-79cd-45e3-a611-e982364ff97c" (UID: "e9553674-79cd-45e3-a611-e982364ff97c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:32.567952 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.567923 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e9553674-79cd-45e3-a611-e982364ff97c" (UID: "e9553674-79cd-45e3-a611-e982364ff97c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:32.569599 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.569572 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9553674-79cd-45e3-a611-e982364ff97c-kube-api-access-f6b6d" (OuterVolumeSpecName: "kube-api-access-f6b6d") pod "e9553674-79cd-45e3-a611-e982364ff97c" (UID: "e9553674-79cd-45e3-a611-e982364ff97c"). InnerVolumeSpecName "kube-api-access-f6b6d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:32.569599 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.569583 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e9553674-79cd-45e3-a611-e982364ff97c" (UID: "e9553674-79cd-45e3-a611-e982364ff97c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:32.569730 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.569600 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e9553674-79cd-45e3-a611-e982364ff97c" (UID: "e9553674-79cd-45e3-a611-e982364ff97c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:32.668203 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.668175 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-oauth-serving-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:32.668319 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.668210 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-serving-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:32.668319 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.668226 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-service-ca\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:32.668319 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.668239 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6b6d\" (UniqueName: \"kubernetes.io/projected/e9553674-79cd-45e3-a611-e982364ff97c-kube-api-access-f6b6d\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:32.668319 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.668253 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e9553674-79cd-45e3-a611-e982364ff97c-console-config\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:32.668319 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.668266 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e9553674-79cd-45e3-a611-e982364ff97c-console-oauth-config\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:32.812845 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.812816 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b787c8cc5-2flc9"] Jul 06 19:56:32.818783 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:32.818757 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b787c8cc5-2flc9"] Jul 06 19:56:33.323999 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:33.323967 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9553674-79cd-45e3-a611-e982364ff97c" path="/var/lib/kubelet/pods/e9553674-79cd-45e3-a611-e982364ff97c/volumes" Jul 06 19:56:33.497061 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:33.497017 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkhqs" event={"ID":"0728ac1f-e602-41f4-8133-77a0fb7696a7","Type":"ContainerStarted","Data":"cc3dc5259e62c4e45b95ede41dc3b46c15550085111020e86a66f15929b4f994"} Jul 06 19:56:33.497246 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:33.497077 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jkhqs" event={"ID":"0728ac1f-e602-41f4-8133-77a0fb7696a7","Type":"ContainerStarted","Data":"7efdca137af255081df58dda0ddc8a12b8922a1b9e8aff7074e31805f45cc512"} Jul 06 19:56:33.515228 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:33.515172 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jkhqs" podStartSLOduration=374.492129623 podStartE2EDuration="6m15.515158982s" totalImagesPullingTime="1.023029359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:33.513349344 +0000 UTC m=+376.784103644" watchObservedRunningTime="2026-07-06 19:56:33.515158982 +0000 UTC m=+376.785913281" Jul 06 19:56:50.840215 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:50.840178 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:56:50.840681 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:50.840455 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="alertmanager" containerID="cri-o://0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f" gracePeriod=120 Jul 06 19:56:50.840681 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:50.840484 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-metric" containerID="cri-o://79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b" gracePeriod=120 Jul 06 19:56:50.840681 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:50.840517 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="config-reloader" containerID="cri-o://e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b" gracePeriod=120 Jul 06 19:56:50.840681 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:50.840464 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy" containerID="cri-o://3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba" gracePeriod=120 Jul 06 19:56:50.840681 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:50.840507 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="prom-label-proxy" containerID="cri-o://d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6" gracePeriod=120 Jul 06 19:56:50.841041 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:50.840507 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-web" containerID="cri-o://f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f" gracePeriod=120 Jul 06 19:56:51.573584 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573555 2558 generic.go:356] "Generic (PLEG): container finished" podID="51f371ea-f697-4201-b8ac-91503290bb21" containerID="d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6" exitCode=0 Jul 06 19:56:51.573584 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573576 2558 generic.go:356] "Generic (PLEG): container finished" podID="51f371ea-f697-4201-b8ac-91503290bb21" containerID="3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba" exitCode=0 Jul 06 19:56:51.573584 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573583 2558 generic.go:356] "Generic (PLEG): container finished" podID="51f371ea-f697-4201-b8ac-91503290bb21" containerID="e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b" exitCode=0 Jul 06 19:56:51.573584 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573588 2558 generic.go:356] "Generic (PLEG): container finished" podID="51f371ea-f697-4201-b8ac-91503290bb21" containerID="0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f" exitCode=0 Jul 06 19:56:51.573981 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6"} Jul 06 19:56:51.573981 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba"} Jul 06 19:56:51.573981 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573761 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b"} Jul 06 19:56:51.573981 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:51.573802 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f"} Jul 06 19:56:52.081413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.081388 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.234393 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234312 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-web\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234393 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234349 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-metrics-client-ca\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234393 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234377 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-config-out\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234405 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234430 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-tls-assets\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234456 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-cluster-tls-config\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234485 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-config-volume\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234523 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-main-db\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234548 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-web-config\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234570 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234609 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhtnt\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-kube-api-access-rhtnt\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.234664 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234666 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-main-tls\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.235112 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234711 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-metric\") pod \"51f371ea-f697-4201-b8ac-91503290bb21\" (UID: \"51f371ea-f697-4201-b8ac-91503290bb21\") " Jul 06 19:56:52.235112 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234772 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:52.235112 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.234987 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-metrics-client-ca\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.235697 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.235576 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:52.235697 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.235661 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:56:52.237334 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.237296 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-config-out" (OuterVolumeSpecName: "config-out") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:56:52.237691 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.237658 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:52.237866 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.237829 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:52.238034 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.238009 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:52.238267 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.238247 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:52.238547 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.238530 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-config-volume" (OuterVolumeSpecName: "config-volume") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:52.238842 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.238804 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:52.238942 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.238906 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-kube-api-access-rhtnt" (OuterVolumeSpecName: "kube-api-access-rhtnt") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "kube-api-access-rhtnt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:56:52.241618 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.241590 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:52.247835 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.247809 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-web-config" (OuterVolumeSpecName: "web-config") pod "51f371ea-f697-4201-b8ac-91503290bb21" (UID: "51f371ea-f697-4201-b8ac-91503290bb21"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:56:52.335629 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335595 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-tls-assets\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335629 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335623 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-cluster-tls-config\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335632 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-config-volume\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335678 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-main-db\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335691 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-web-config\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335704 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51f371ea-f697-4201-b8ac-91503290bb21-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335714 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhtnt\" (UniqueName: \"kubernetes.io/projected/51f371ea-f697-4201-b8ac-91503290bb21-kube-api-access-rhtnt\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335722 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-main-tls\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335731 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335740 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335747 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51f371ea-f697-4201-b8ac-91503290bb21-config-out\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.335843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.335756 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51f371ea-f697-4201-b8ac-91503290bb21-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 19:56:52.580439 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.580352 2558 generic.go:356] "Generic (PLEG): container finished" podID="51f371ea-f697-4201-b8ac-91503290bb21" containerID="79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b" exitCode=0 Jul 06 19:56:52.580439 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.580380 2558 generic.go:356] "Generic (PLEG): container finished" podID="51f371ea-f697-4201-b8ac-91503290bb21" containerID="f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f" exitCode=0 Jul 06 19:56:52.580609 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.580442 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.580609 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.580440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b"} Jul 06 19:56:52.580609 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.580555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f"} Jul 06 19:56:52.580609 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.580598 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51f371ea-f697-4201-b8ac-91503290bb21","Type":"ContainerDied","Data":"28bea899ae7f5b560fd57fcf2d5284a832c7bd5229756870903689e848d4b044"} Jul 06 19:56:52.580750 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.580616 2558 scope.go:117] "RemoveContainer" containerID="d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6" Jul 06 19:56:52.588439 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.588418 2558 scope.go:117] "RemoveContainer" containerID="79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b" Jul 06 19:56:52.595540 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.595523 2558 scope.go:117] "RemoveContainer" containerID="3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba" Jul 06 19:56:52.601837 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.601822 2558 scope.go:117] "RemoveContainer" containerID="f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f" Jul 06 19:56:52.608111 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.608096 2558 scope.go:117] "RemoveContainer" containerID="e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b" Jul 06 19:56:52.612959 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.612927 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:56:52.615586 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.615571 2558 scope.go:117] "RemoveContainer" containerID="0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f" Jul 06 19:56:52.624294 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.624263 2558 scope.go:117] "RemoveContainer" containerID="4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f" Jul 06 19:56:52.630045 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.630026 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:56:52.631030 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.631019 2558 scope.go:117] "RemoveContainer" containerID="d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6" Jul 06 19:56:52.631311 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:52.631292 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6\": container with ID starting with d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6 not found: ID does not exist" containerID="d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6" Jul 06 19:56:52.631384 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.631325 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6"} err="failed to get container status \"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6\": rpc error: code = NotFound desc = could not find container \"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6\": container with ID starting with d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6 not found: ID does not exist" Jul 06 19:56:52.631384 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.631351 2558 scope.go:117] "RemoveContainer" containerID="79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b" Jul 06 19:56:52.631620 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:52.631603 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b\": container with ID starting with 79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b not found: ID does not exist" containerID="79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b" Jul 06 19:56:52.631679 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.631646 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b"} err="failed to get container status \"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b\": rpc error: code = NotFound desc = could not find container \"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b\": container with ID starting with 79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b not found: ID does not exist" Jul 06 19:56:52.631679 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.631666 2558 scope.go:117] "RemoveContainer" containerID="3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba" Jul 06 19:56:52.631874 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:52.631857 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba\": container with ID starting with 3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba not found: ID does not exist" containerID="3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba" Jul 06 19:56:52.631938 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.631881 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba"} err="failed to get container status \"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba\": rpc error: code = NotFound desc = could not find container \"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba\": container with ID starting with 3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba not found: ID does not exist" Jul 06 19:56:52.631938 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.631905 2558 scope.go:117] "RemoveContainer" containerID="f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f" Jul 06 19:56:52.632123 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:52.632106 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f\": container with ID starting with f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f not found: ID does not exist" containerID="f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f" Jul 06 19:56:52.632159 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632127 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f"} err="failed to get container status \"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f\": rpc error: code = NotFound desc = could not find container \"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f\": container with ID starting with f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f not found: ID does not exist" Jul 06 19:56:52.632159 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632140 2558 scope.go:117] "RemoveContainer" containerID="e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b" Jul 06 19:56:52.632351 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:52.632336 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b\": container with ID starting with e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b not found: ID does not exist" containerID="e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b" Jul 06 19:56:52.632411 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632357 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b"} err="failed to get container status \"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b\": rpc error: code = NotFound desc = could not find container \"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b\": container with ID starting with e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b not found: ID does not exist" Jul 06 19:56:52.632411 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632375 2558 scope.go:117] "RemoveContainer" containerID="0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f" Jul 06 19:56:52.632586 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:52.632569 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f\": container with ID starting with 0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f not found: ID does not exist" containerID="0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f" Jul 06 19:56:52.632715 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632592 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f"} err="failed to get container status \"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f\": rpc error: code = NotFound desc = could not find container \"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f\": container with ID starting with 0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f not found: ID does not exist" Jul 06 19:56:52.632715 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632610 2558 scope.go:117] "RemoveContainer" containerID="4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f" Jul 06 19:56:52.632878 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:56:52.632863 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f\": container with ID starting with 4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f not found: ID does not exist" containerID="4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f" Jul 06 19:56:52.632916 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632883 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f"} err="failed to get container status \"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f\": rpc error: code = NotFound desc = could not find container \"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f\": container with ID starting with 4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f not found: ID does not exist" Jul 06 19:56:52.632916 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.632896 2558 scope.go:117] "RemoveContainer" containerID="d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6" Jul 06 19:56:52.633108 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633088 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6"} err="failed to get container status \"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6\": rpc error: code = NotFound desc = could not find container \"d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6\": container with ID starting with d1b3ed00a7e2dd76b7c2ebdbb27129d359223eed4b32d857ebb70bccc165ddd6 not found: ID does not exist" Jul 06 19:56:52.633108 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633105 2558 scope.go:117] "RemoveContainer" containerID="79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b" Jul 06 19:56:52.633299 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633281 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b"} err="failed to get container status \"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b\": rpc error: code = NotFound desc = could not find container \"79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b\": container with ID starting with 79f02e8a21f0c891414c2cf41e33f60bd831e15ff256b20888a05918b51e3c9b not found: ID does not exist" Jul 06 19:56:52.633363 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633301 2558 scope.go:117] "RemoveContainer" containerID="3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba" Jul 06 19:56:52.633497 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633480 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba"} err="failed to get container status \"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba\": rpc error: code = NotFound desc = could not find container \"3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba\": container with ID starting with 3ada682439550210a9080838060d880f7c6bad86bc47e048ac1da1e4912cbbba not found: ID does not exist" Jul 06 19:56:52.633560 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633498 2558 scope.go:117] "RemoveContainer" containerID="f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f" Jul 06 19:56:52.633687 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633669 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f"} err="failed to get container status \"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f\": rpc error: code = NotFound desc = could not find container \"f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f\": container with ID starting with f7114039cb2aebab03a0e99064231dc2cb31e83c8598c173136a9d5beeccc25f not found: ID does not exist" Jul 06 19:56:52.633743 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633688 2558 scope.go:117] "RemoveContainer" containerID="e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b" Jul 06 19:56:52.633906 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633889 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b"} err="failed to get container status \"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b\": rpc error: code = NotFound desc = could not find container \"e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b\": container with ID starting with e212a6fbb73dadc7748704ce4b70379b162fffc34a2cc099c73a50ccc9e7678b not found: ID does not exist" Jul 06 19:56:52.633949 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.633908 2558 scope.go:117] "RemoveContainer" containerID="0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f" Jul 06 19:56:52.634108 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.634090 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f"} err="failed to get container status \"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f\": rpc error: code = NotFound desc = could not find container \"0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f\": container with ID starting with 0aa6befcc6c017077056b54b829e0aad9b5745bd92d0379d30d2f103e256f21f not found: ID does not exist" Jul 06 19:56:52.634173 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.634109 2558 scope.go:117] "RemoveContainer" containerID="4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f" Jul 06 19:56:52.634325 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.634309 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f"} err="failed to get container status \"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f\": rpc error: code = NotFound desc = could not find container \"4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f\": container with ID starting with 4daf022af41285220b404c3534358401bc9ef5f781e1054b43839352c1468e1f not found: ID does not exist" Jul 06 19:56:52.666571 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666543 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:56:52.666838 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666826 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="config-reloader" Jul 06 19:56:52.666889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666839 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="config-reloader" Jul 06 19:56:52.666889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666851 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy" Jul 06 19:56:52.666889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666856 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy" Jul 06 19:56:52.666889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666866 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-web" Jul 06 19:56:52.666889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666871 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-web" Jul 06 19:56:52.666889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666878 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-metric" Jul 06 19:56:52.666889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666886 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-metric" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666895 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="init-config-reloader" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666901 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="init-config-reloader" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666907 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="prom-label-proxy" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666912 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="prom-label-proxy" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666921 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9553674-79cd-45e3-a611-e982364ff97c" containerName="console" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666926 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9553674-79cd-45e3-a611-e982364ff97c" containerName="console" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666932 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" containerName="registry" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666937 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" containerName="registry" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666943 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="alertmanager" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666948 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="alertmanager" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.666995 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.667002 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="alertmanager" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.667009 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9553674-79cd-45e3-a611-e982364ff97c" containerName="console" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.667015 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-metric" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.667021 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="kube-rbac-proxy-web" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.667025 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdaa6929-3ff9-4a46-ad30-ca2a8962f509" containerName="registry" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.667031 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="config-reloader" Jul 06 19:56:52.667079 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.667036 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="51f371ea-f697-4201-b8ac-91503290bb21" containerName="prom-label-proxy" Jul 06 19:56:52.671768 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.671751 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.674366 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674347 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:56:52.674474 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674402 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:56:52.674474 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674419 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-fpqtq\"" Jul 06 19:56:52.674474 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674402 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:56:52.674832 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674687 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:56:52.674832 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674765 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:56:52.674832 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674780 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:56:52.674985 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674916 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:56:52.674985 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.674945 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:56:52.679332 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.679316 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:56:52.686734 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.686711 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:56:52.840772 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840675 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9d517fc-7c0e-4586-be43-a51544621455-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.840772 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-web-config\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.840772 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d517fc-7c0e-4586-be43-a51544621455-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840792 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9d517fc-7c0e-4586-be43-a51544621455-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840824 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840841 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6m9k\" (UniqueName: \"kubernetes.io/projected/b9d517fc-7c0e-4586-be43-a51544621455-kube-api-access-m6m9k\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.840966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841013 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.841003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9d517fc-7c0e-4586-be43-a51544621455-config-out\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.841277 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.841031 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9d517fc-7c0e-4586-be43-a51544621455-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941756 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941721 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9d517fc-7c0e-4586-be43-a51544621455-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941914 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-web-config\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941914 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941784 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d517fc-7c0e-4586-be43-a51544621455-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941914 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9d517fc-7c0e-4586-be43-a51544621455-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941914 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941817 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941914 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941914 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941856 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.941914 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6m9k\" (UniqueName: \"kubernetes.io/projected/b9d517fc-7c0e-4586-be43-a51544621455-kube-api-access-m6m9k\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.942231 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941942 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.942231 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.941980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.942231 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.942018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.942231 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.942040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9d517fc-7c0e-4586-be43-a51544621455-config-out\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.942231 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.942053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9d517fc-7c0e-4586-be43-a51544621455-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.942231 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.942208 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b9d517fc-7c0e-4586-be43-a51544621455-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.942796 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.942775 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b9d517fc-7c0e-4586-be43-a51544621455-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.943216 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.943179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9d517fc-7c0e-4586-be43-a51544621455-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.944951 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.944924 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.945422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.945126 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b9d517fc-7c0e-4586-be43-a51544621455-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.945422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.945299 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.945422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.945350 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.945422 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.945389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-web-config\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.945696 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.945547 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-config-volume\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.945696 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.945624 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.945764 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.945738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b9d517fc-7c0e-4586-be43-a51544621455-config-out\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.946911 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.946894 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b9d517fc-7c0e-4586-be43-a51544621455-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.950970 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.950952 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6m9k\" (UniqueName: \"kubernetes.io/projected/b9d517fc-7c0e-4586-be43-a51544621455-kube-api-access-m6m9k\") pod \"alertmanager-main-0\" (UID: \"b9d517fc-7c0e-4586-be43-a51544621455\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:52.980950 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:52.980919 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:56:53.121230 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:53.121146 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:56:53.123842 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:56:53.123813 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d517fc_7c0e_4586_be43_a51544621455.slice/crio-c70c1891a1f7d04f9350ed7e27554c17ce5b0194ba237fdef65c180b5720f5b8 WatchSource:0}: Error finding container c70c1891a1f7d04f9350ed7e27554c17ce5b0194ba237fdef65c180b5720f5b8: Status 404 returned error can't find the container with id c70c1891a1f7d04f9350ed7e27554c17ce5b0194ba237fdef65c180b5720f5b8 Jul 06 19:56:53.319053 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:53.319024 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51f371ea-f697-4201-b8ac-91503290bb21" path="/var/lib/kubelet/pods/51f371ea-f697-4201-b8ac-91503290bb21/volumes" Jul 06 19:56:53.585308 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:53.585276 2558 generic.go:356] "Generic (PLEG): container finished" podID="b9d517fc-7c0e-4586-be43-a51544621455" containerID="4583a2e22f61a7400b818f89e3168edd14625f62aaf339733f84f23aaef0aad0" exitCode=0 Jul 06 19:56:53.585470 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:53.585357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerDied","Data":"4583a2e22f61a7400b818f89e3168edd14625f62aaf339733f84f23aaef0aad0"} Jul 06 19:56:53.585470 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:53.585422 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerStarted","Data":"c70c1891a1f7d04f9350ed7e27554c17ce5b0194ba237fdef65c180b5720f5b8"} Jul 06 19:56:54.593932 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:54.593897 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerStarted","Data":"f4cf83b80dab5d525a8079a6597d6b00057e2dbb026cd42208ebd88b971ccb5c"} Jul 06 19:56:54.594405 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:54.593979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerStarted","Data":"21b5ce9ed44885ba9bd9299bf3d51021ff0abe51bfc062b69b5c814054e4754d"} Jul 06 19:56:54.594405 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:54.594019 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerStarted","Data":"87f2bf996d42d06e6506cc587a3f45956b5cefbc68216d1efbce71acb01c956c"} Jul 06 19:56:54.594405 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:54.594065 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerStarted","Data":"f747a780f59e8dc4cb09e8c488b51ddbb67de1abe0d61a27378f81e3721d9bf9"} Jul 06 19:56:54.594405 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:54.594103 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerStarted","Data":"0f4c5d78a1b4a773bbed6d3ea56d196e598c2dc7eefee0f9cee7361bf4019c17"} Jul 06 19:56:54.594405 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:54.594144 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b9d517fc-7c0e-4586-be43-a51544621455","Type":"ContainerStarted","Data":"27a5323900387d81c5b43ece09ec3e97cbf7cbe3bc78a996cab1bb3a0793a435"} Jul 06 19:56:54.627630 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:54.627578 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.611991306 podStartE2EDuration="2.627562087s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.570781ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:54.625098896 +0000 UTC m=+397.895853199" watchObservedRunningTime="2026-07-06 19:56:54.627562087 +0000 UTC m=+397.898316386" Jul 06 19:56:55.432851 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.432820 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-584c6c56d7-ffgtm"] Jul 06 19:56:55.436371 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.436348 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.439148 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.439127 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:56:55.439281 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.439180 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:56:55.439590 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.439567 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:56:55.439739 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.439626 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:56:55.440241 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.440215 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-b9gjw\"" Jul 06 19:56:55.440815 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.440781 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:56:55.440907 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.440834 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:56:55.440961 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.440909 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:56:55.445129 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.445109 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:56:55.452286 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.452268 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584c6c56d7-ffgtm"] Jul 06 19:56:55.563515 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.563480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-oauth-serving-cert\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.563515 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.563522 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scgj4\" (UniqueName: \"kubernetes.io/projected/70df8642-31f3-4891-a50a-9321926651f1-kube-api-access-scgj4\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.563759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.563577 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-trusted-ca-bundle\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.563759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.563598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-service-ca\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.563759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.563683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-console-config\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.563759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.563714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-oauth-config\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.563759 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.563736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-serving-cert\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.664468 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.664430 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-oauth-config\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.664946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.664474 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-serving-cert\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.664946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.664506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-oauth-serving-cert\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.664946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.664540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scgj4\" (UniqueName: \"kubernetes.io/projected/70df8642-31f3-4891-a50a-9321926651f1-kube-api-access-scgj4\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.664946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.664678 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-trusted-ca-bundle\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.664946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.664725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-service-ca\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.664946 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.664774 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-console-config\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.665311 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.665290 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-oauth-serving-cert\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.665494 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.665472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-console-config\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.665551 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.665530 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-trusted-ca-bundle\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.665551 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.665533 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-service-ca\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.666999 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.666979 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-serving-cert\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.667086 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.667000 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-oauth-config\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.673121 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.673100 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scgj4\" (UniqueName: \"kubernetes.io/projected/70df8642-31f3-4891-a50a-9321926651f1-kube-api-access-scgj4\") pod \"console-584c6c56d7-ffgtm\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.746929 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.746837 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:56:55.873193 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:55.873166 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-584c6c56d7-ffgtm"] Jul 06 19:56:55.875461 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:56:55.875431 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70df8642_31f3_4891_a50a_9321926651f1.slice/crio-69c502ad9938493e4fc9ff60e736940a51c3432267108fc5cb646c5e4d45da0f WatchSource:0}: Error finding container 69c502ad9938493e4fc9ff60e736940a51c3432267108fc5cb646c5e4d45da0f: Status 404 returned error can't find the container with id 69c502ad9938493e4fc9ff60e736940a51c3432267108fc5cb646c5e4d45da0f Jul 06 19:56:56.609650 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:56.609600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584c6c56d7-ffgtm" event={"ID":"70df8642-31f3-4891-a50a-9321926651f1","Type":"ContainerStarted","Data":"f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db"} Jul 06 19:56:56.609826 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:56.609704 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584c6c56d7-ffgtm" event={"ID":"70df8642-31f3-4891-a50a-9321926651f1","Type":"ContainerStarted","Data":"69c502ad9938493e4fc9ff60e736940a51c3432267108fc5cb646c5e4d45da0f"} Jul 06 19:56:56.630156 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:56:56.630110 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-584c6c56d7-ffgtm" podStartSLOduration=1.6300975530000001 podStartE2EDuration="1.630097553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:56.629014981 +0000 UTC m=+399.899769275" watchObservedRunningTime="2026-07-06 19:56:56.630097553 +0000 UTC m=+399.900851853" Jul 06 19:57:03.098720 ip-10-0-135-185 kubenswrapper[2558]: E0706 19:57:03.098677 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" podUID="adabb4c7-ecfe-4204-bace-10996203e1f1" Jul 06 19:57:03.637280 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:03.637247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:57:05.045687 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.045653 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:57:05.048080 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.048055 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/adabb4c7-ecfe-4204-bace-10996203e1f1-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-9qjlv\" (UID: \"adabb4c7-ecfe-4204-bace-10996203e1f1\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:57:05.140519 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.140484 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lg2mq\"" Jul 06 19:57:05.148631 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.148607 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" Jul 06 19:57:05.274782 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.274749 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv"] Jul 06 19:57:05.277607 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:57:05.277582 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadabb4c7_ecfe_4204_bace_10996203e1f1.slice/crio-95efcadcf6c12607fbd417b519a062a4d5c83f5a5ad339b76b1ebace279cf42f WatchSource:0}: Error finding container 95efcadcf6c12607fbd417b519a062a4d5c83f5a5ad339b76b1ebace279cf42f: Status 404 returned error can't find the container with id 95efcadcf6c12607fbd417b519a062a4d5c83f5a5ad339b76b1ebace279cf42f Jul 06 19:57:05.646553 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.646517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" event={"ID":"adabb4c7-ecfe-4204-bace-10996203e1f1","Type":"ContainerStarted","Data":"95efcadcf6c12607fbd417b519a062a4d5c83f5a5ad339b76b1ebace279cf42f"} Jul 06 19:57:05.747253 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.747214 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:57:05.747412 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.747285 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:57:05.751744 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:05.751722 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:57:06.651865 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:06.651832 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" event={"ID":"adabb4c7-ecfe-4204-bace-10996203e1f1","Type":"ContainerStarted","Data":"91a8de7a1a367741b07e21ab09933cdec21913a5fece84c213c889ca351e6661"} Jul 06 19:57:06.655702 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:06.655678 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 19:57:06.670732 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:57:06.670685 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-9qjlv" podStartSLOduration=388.431506341 podStartE2EDuration="6m29.670671227s" totalImagesPullingTime="1.239164886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:57:06.669577557 +0000 UTC m=+409.940331857" watchObservedRunningTime="2026-07-06 19:57:06.670671227 +0000 UTC m=+409.941425537" Jul 06 19:58:11.485350 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.485318 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9"] Jul 06 19:58:11.488497 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.488481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.491122 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.491098 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:58:11.491264 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.491174 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w9wfg\"" Jul 06 19:58:11.491363 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.491349 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 06 19:58:11.506014 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.505988 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9"] Jul 06 19:58:11.591278 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.591240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf5d0787-9289-48f1-958a-e7ce2f76a79d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wkkm9\" (UID: \"cf5d0787-9289-48f1-958a-e7ce2f76a79d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.591438 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.591284 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5gt9\" (UniqueName: \"kubernetes.io/projected/cf5d0787-9289-48f1-958a-e7ce2f76a79d-kube-api-access-q5gt9\") pod \"cert-manager-operator-controller-manager-55c444bf86-wkkm9\" (UID: \"cf5d0787-9289-48f1-958a-e7ce2f76a79d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.692752 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.692715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf5d0787-9289-48f1-958a-e7ce2f76a79d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wkkm9\" (UID: \"cf5d0787-9289-48f1-958a-e7ce2f76a79d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.692884 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.692758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gt9\" (UniqueName: \"kubernetes.io/projected/cf5d0787-9289-48f1-958a-e7ce2f76a79d-kube-api-access-q5gt9\") pod \"cert-manager-operator-controller-manager-55c444bf86-wkkm9\" (UID: \"cf5d0787-9289-48f1-958a-e7ce2f76a79d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.693114 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.693097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cf5d0787-9289-48f1-958a-e7ce2f76a79d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-wkkm9\" (UID: \"cf5d0787-9289-48f1-958a-e7ce2f76a79d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.701504 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.701475 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5gt9\" (UniqueName: \"kubernetes.io/projected/cf5d0787-9289-48f1-958a-e7ce2f76a79d-kube-api-access-q5gt9\") pod \"cert-manager-operator-controller-manager-55c444bf86-wkkm9\" (UID: \"cf5d0787-9289-48f1-958a-e7ce2f76a79d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.797835 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.797744 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" Jul 06 19:58:11.951484 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:11.951441 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9"] Jul 06 19:58:11.954796 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:58:11.954771 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf5d0787_9289_48f1_958a_e7ce2f76a79d.slice/crio-6ecd71fd83e0876718b66db002fa15a6b5c36d5a5b591fe7136e2130e939bbee WatchSource:0}: Error finding container 6ecd71fd83e0876718b66db002fa15a6b5c36d5a5b591fe7136e2130e939bbee: Status 404 returned error can't find the container with id 6ecd71fd83e0876718b66db002fa15a6b5c36d5a5b591fe7136e2130e939bbee Jul 06 19:58:12.904356 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:12.904323 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" event={"ID":"cf5d0787-9289-48f1-958a-e7ce2f76a79d","Type":"ContainerStarted","Data":"6ecd71fd83e0876718b66db002fa15a6b5c36d5a5b591fe7136e2130e939bbee"} Jul 06 19:58:22.947954 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:22.947914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" event={"ID":"cf5d0787-9289-48f1-958a-e7ce2f76a79d","Type":"ContainerStarted","Data":"74f082328d5d1b062e8c1988633de29acc3b4a0a9e5f3eaf052956b48f4db8c4"} Jul 06 19:58:22.975896 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:22.975847 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-wkkm9" podStartSLOduration=1.623682034 podStartE2EDuration="11.975831905s" totalImagesPullingTime="10.352149871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:22.975798901 +0000 UTC m=+486.246553200" watchObservedRunningTime="2026-07-06 19:58:22.975831905 +0000 UTC m=+486.246586205" Jul 06 19:58:23.063375 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.063337 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tmkhx"] Jul 06 19:58:23.066716 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.066700 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.069577 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.069555 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 06 19:58:23.069577 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.069560 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 06 19:58:23.069767 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.069588 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xtmfr\"" Jul 06 19:58:23.078555 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.078530 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tmkhx"] Jul 06 19:58:23.200582 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.200499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7plj\" (UniqueName: \"kubernetes.io/projected/0fe66943-1dca-47c4-841a-bd7833dea133-kube-api-access-s7plj\") pod \"cert-manager-webhook-6486ffd997-tmkhx\" (UID: \"0fe66943-1dca-47c4-841a-bd7833dea133\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.200582 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.200550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fe66943-1dca-47c4-841a-bd7833dea133-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tmkhx\" (UID: \"0fe66943-1dca-47c4-841a-bd7833dea133\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.301320 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.301283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7plj\" (UniqueName: \"kubernetes.io/projected/0fe66943-1dca-47c4-841a-bd7833dea133-kube-api-access-s7plj\") pod \"cert-manager-webhook-6486ffd997-tmkhx\" (UID: \"0fe66943-1dca-47c4-841a-bd7833dea133\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.301490 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.301344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fe66943-1dca-47c4-841a-bd7833dea133-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tmkhx\" (UID: \"0fe66943-1dca-47c4-841a-bd7833dea133\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.320216 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.320191 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7plj\" (UniqueName: \"kubernetes.io/projected/0fe66943-1dca-47c4-841a-bd7833dea133-kube-api-access-s7plj\") pod \"cert-manager-webhook-6486ffd997-tmkhx\" (UID: \"0fe66943-1dca-47c4-841a-bd7833dea133\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.320841 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.320820 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0fe66943-1dca-47c4-841a-bd7833dea133-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tmkhx\" (UID: \"0fe66943-1dca-47c4-841a-bd7833dea133\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.384119 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.384087 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:23.524175 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:58:23.524142 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fe66943_1dca_47c4_841a_bd7833dea133.slice/crio-f7ba8c52cc4975ba6a3a2cd5c9e907b751cc74d508fbf2e265ee607ff860061e WatchSource:0}: Error finding container f7ba8c52cc4975ba6a3a2cd5c9e907b751cc74d508fbf2e265ee607ff860061e: Status 404 returned error can't find the container with id f7ba8c52cc4975ba6a3a2cd5c9e907b751cc74d508fbf2e265ee607ff860061e Jul 06 19:58:23.524283 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.524175 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tmkhx"] Jul 06 19:58:23.953609 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:23.953564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" event={"ID":"0fe66943-1dca-47c4-841a-bd7833dea133","Type":"ContainerStarted","Data":"f7ba8c52cc4975ba6a3a2cd5c9e907b751cc74d508fbf2e265ee607ff860061e"} Jul 06 19:58:26.969235 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:26.969194 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" event={"ID":"0fe66943-1dca-47c4-841a-bd7833dea133","Type":"ContainerStarted","Data":"8740b6efcf948883d74305055c5fd378192b4d12d141663a54602fcbb4225417"} Jul 06 19:58:26.969608 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:26.969276 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:26.986752 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:26.986703 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" podStartSLOduration=1.4464032900000001 podStartE2EDuration="3.986688658s" totalImagesPullingTime="2.540285368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:26.986671193 +0000 UTC m=+490.257425494" watchObservedRunningTime="2026-07-06 19:58:26.986688658 +0000 UTC m=+490.257442948" Jul 06 19:58:32.976485 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:32.976455 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tmkhx" Jul 06 19:58:33.688648 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.688598 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-67wf6"] Jul 06 19:58:33.691924 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.691908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:33.694186 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.694160 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-4tnpt\"" Jul 06 19:58:33.701014 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.700991 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-67wf6"] Jul 06 19:58:33.791510 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.791468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcd6b\" (UniqueName: \"kubernetes.io/projected/602d239a-6693-42d7-a8b3-2316ea5fd3da-kube-api-access-mcd6b\") pod \"cert-manager-55b4d954d5-67wf6\" (UID: \"602d239a-6693-42d7-a8b3-2316ea5fd3da\") " pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:33.791726 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.791531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/602d239a-6693-42d7-a8b3-2316ea5fd3da-bound-sa-token\") pod \"cert-manager-55b4d954d5-67wf6\" (UID: \"602d239a-6693-42d7-a8b3-2316ea5fd3da\") " pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:33.892348 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.892313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcd6b\" (UniqueName: \"kubernetes.io/projected/602d239a-6693-42d7-a8b3-2316ea5fd3da-kube-api-access-mcd6b\") pod \"cert-manager-55b4d954d5-67wf6\" (UID: \"602d239a-6693-42d7-a8b3-2316ea5fd3da\") " pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:33.892538 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.892359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/602d239a-6693-42d7-a8b3-2316ea5fd3da-bound-sa-token\") pod \"cert-manager-55b4d954d5-67wf6\" (UID: \"602d239a-6693-42d7-a8b3-2316ea5fd3da\") " pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:33.900576 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.900552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/602d239a-6693-42d7-a8b3-2316ea5fd3da-bound-sa-token\") pod \"cert-manager-55b4d954d5-67wf6\" (UID: \"602d239a-6693-42d7-a8b3-2316ea5fd3da\") " pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:33.900750 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:33.900730 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcd6b\" (UniqueName: \"kubernetes.io/projected/602d239a-6693-42d7-a8b3-2316ea5fd3da-kube-api-access-mcd6b\") pod \"cert-manager-55b4d954d5-67wf6\" (UID: \"602d239a-6693-42d7-a8b3-2316ea5fd3da\") " pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:34.000372 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:34.000276 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-67wf6" Jul 06 19:58:34.128391 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:34.128325 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-67wf6"] Jul 06 19:58:34.130917 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:58:34.130885 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod602d239a_6693_42d7_a8b3_2316ea5fd3da.slice/crio-ac5927206b835bad60cdbe5a12d905f8d95f287c876ea5af83fbad68a39e53d5 WatchSource:0}: Error finding container ac5927206b835bad60cdbe5a12d905f8d95f287c876ea5af83fbad68a39e53d5: Status 404 returned error can't find the container with id ac5927206b835bad60cdbe5a12d905f8d95f287c876ea5af83fbad68a39e53d5 Jul 06 19:58:35.008451 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:35.008418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-67wf6" event={"ID":"602d239a-6693-42d7-a8b3-2316ea5fd3da","Type":"ContainerStarted","Data":"3e5e882cca5d1c0fe7885a93542fdf659dd7110eb2f7fb038c8c7cfb7f587d89"} Jul 06 19:58:35.008836 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:35.008459 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-67wf6" event={"ID":"602d239a-6693-42d7-a8b3-2316ea5fd3da","Type":"ContainerStarted","Data":"ac5927206b835bad60cdbe5a12d905f8d95f287c876ea5af83fbad68a39e53d5"} Jul 06 19:58:35.026573 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:35.026526 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-67wf6" podStartSLOduration=2.026512373 podStartE2EDuration="2.026512373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:35.02544258 +0000 UTC m=+498.296196879" watchObservedRunningTime="2026-07-06 19:58:35.026512373 +0000 UTC m=+498.297266672" Jul 06 19:58:37.400121 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.400086 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw"] Jul 06 19:58:37.403442 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.403426 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.405907 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.405884 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 19:58:37.406877 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.406857 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:58:37.406965 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.406915 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rmc8g\"" Jul 06 19:58:37.418606 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.418581 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw"] Jul 06 19:58:37.524273 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.524238 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csrtq\" (UniqueName: \"kubernetes.io/projected/0bd7a6f6-3fd3-4b36-897b-4e8e8298d480-kube-api-access-csrtq\") pod \"openshift-lws-operator-fd8ccff4c-gtqnw\" (UID: \"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.524452 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.524297 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bd7a6f6-3fd3-4b36-897b-4e8e8298d480-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gtqnw\" (UID: \"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.625496 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.625448 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csrtq\" (UniqueName: \"kubernetes.io/projected/0bd7a6f6-3fd3-4b36-897b-4e8e8298d480-kube-api-access-csrtq\") pod \"openshift-lws-operator-fd8ccff4c-gtqnw\" (UID: \"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.625740 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.625525 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bd7a6f6-3fd3-4b36-897b-4e8e8298d480-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gtqnw\" (UID: \"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.625953 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.625932 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bd7a6f6-3fd3-4b36-897b-4e8e8298d480-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gtqnw\" (UID: \"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.638931 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.638902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csrtq\" (UniqueName: \"kubernetes.io/projected/0bd7a6f6-3fd3-4b36-897b-4e8e8298d480-kube-api-access-csrtq\") pod \"openshift-lws-operator-fd8ccff4c-gtqnw\" (UID: \"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.712454 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.712415 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" Jul 06 19:58:37.842483 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:37.842451 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw"] Jul 06 19:58:37.845204 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:58:37.845171 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bd7a6f6_3fd3_4b36_897b_4e8e8298d480.slice/crio-f577f487a1fe04ad02752090fa7f40084393aec4fb7d1787e8e88ef2953116d5 WatchSource:0}: Error finding container f577f487a1fe04ad02752090fa7f40084393aec4fb7d1787e8e88ef2953116d5: Status 404 returned error can't find the container with id f577f487a1fe04ad02752090fa7f40084393aec4fb7d1787e8e88ef2953116d5 Jul 06 19:58:38.022468 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:38.022380 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" event={"ID":"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480","Type":"ContainerStarted","Data":"f577f487a1fe04ad02752090fa7f40084393aec4fb7d1787e8e88ef2953116d5"} Jul 06 19:58:41.040291 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:41.040249 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" event={"ID":"0bd7a6f6-3fd3-4b36-897b-4e8e8298d480","Type":"ContainerStarted","Data":"e867ade8bb5ba3816906e1ed35c2dc17f7a855cb7baab29aa764352684d0ee69"} Jul 06 19:58:41.060298 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:58:41.060244 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gtqnw" podStartSLOduration=1.676490016 podStartE2EDuration="4.060229646s" totalImagesPullingTime="2.38373963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:58:41.057943333 +0000 UTC m=+504.328697634" watchObservedRunningTime="2026-07-06 19:58:41.060229646 +0000 UTC m=+504.330983946" Jul 06 19:59:00.181866 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.181831 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf"] Jul 06 19:59:00.187853 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.187830 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.190588 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.190557 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 19:59:00.190723 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.190615 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 19:59:00.190811 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.190794 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xmgfq\"" Jul 06 19:59:00.190912 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.190891 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 19:59:00.190956 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.190939 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 19:59:00.210214 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.210182 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf"] Jul 06 19:59:00.211299 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.211274 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-tmp\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.211431 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.211375 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-manifests\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.211431 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.211419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8bt8\" (UniqueName: \"kubernetes.io/projected/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-kube-api-access-l8bt8\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.211533 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.211451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.211569 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.211524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.312398 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.312359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-manifests\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.312398 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.312400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8bt8\" (UniqueName: \"kubernetes.io/projected/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-kube-api-access-l8bt8\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.312614 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.312417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.312614 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.312441 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.312614 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.312559 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-tmp\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.312889 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.312861 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-manifests\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.314777 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.314748 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-tmp\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.314980 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.314964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.315026 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.315001 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.321526 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.321505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8bt8\" (UniqueName: \"kubernetes.io/projected/1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a-kube-api-access-l8bt8\") pod \"opendatahub-operator-controller-manager-87fbc8964-zzwnf\" (UID: \"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a\") " pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.498784 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.498684 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:00.645993 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:00.645963 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf"] Jul 06 19:59:00.649024 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:59:00.648993 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea3fa16_40c0_43dc_9f59_fe0ab9dfbd8a.slice/crio-1ab74d50b7c2871db7f42e049594b4846cf79998f65a73563175920310f4ef84 WatchSource:0}: Error finding container 1ab74d50b7c2871db7f42e049594b4846cf79998f65a73563175920310f4ef84: Status 404 returned error can't find the container with id 1ab74d50b7c2871db7f42e049594b4846cf79998f65a73563175920310f4ef84 Jul 06 19:59:01.129937 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:01.129879 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" event={"ID":"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a","Type":"ContainerStarted","Data":"1ab74d50b7c2871db7f42e049594b4846cf79998f65a73563175920310f4ef84"} Jul 06 19:59:04.148197 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:04.148157 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" event={"ID":"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a","Type":"ContainerStarted","Data":"92ee5140016be1c2d9e126dcdda713248101283f1fa07dd87dfc8d591bbe81ce"} Jul 06 19:59:05.154848 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:05.154757 2558 generic.go:356] "Generic (PLEG): container finished" podID="1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a" containerID="92ee5140016be1c2d9e126dcdda713248101283f1fa07dd87dfc8d591bbe81ce" exitCode=0 Jul 06 19:59:05.155210 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:05.154847 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" event={"ID":"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a","Type":"ContainerDied","Data":"92ee5140016be1c2d9e126dcdda713248101283f1fa07dd87dfc8d591bbe81ce"} Jul 06 19:59:06.161732 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:06.161691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" event={"ID":"1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a","Type":"ContainerStarted","Data":"dbfda3ae4770131c830f685d8127d0d9b4bd52696f6c6cf342c06095aeeca130"} Jul 06 19:59:06.162120 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:06.161846 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:06.184445 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:06.184395 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" podStartSLOduration=1.9262888729999998 podStartE2EDuration="6.1843758s" totalImagesPullingTime="3.167335195s" totalInitContainerRuntime="1.090751732s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:06.182035539 +0000 UTC m=+529.452789840" watchObservedRunningTime="2026-07-06 19:59:06.1843758 +0000 UTC m=+529.455130175" Jul 06 19:59:17.170100 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:17.170019 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-87fbc8964-zzwnf" Jul 06 19:59:19.832153 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.832118 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8"] Jul 06 19:59:19.838226 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.838181 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:19.842366 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.842338 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 06 19:59:19.842527 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.842387 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-lf9m2\"" Jul 06 19:59:19.843418 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.843396 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 19:59:19.843558 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.843433 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 06 19:59:19.843633 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.843618 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 19:59:19.855737 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.855711 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8"] Jul 06 19:59:19.987681 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.987623 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7dcd51a-a418-41d2-bfd1-23715b6cc122-tmp\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:19.987866 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.987766 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqbtg\" (UniqueName: \"kubernetes.io/projected/e7dcd51a-a418-41d2-bfd1-23715b6cc122-kube-api-access-lqbtg\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:19.987866 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:19.987821 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dcd51a-a418-41d2-bfd1-23715b6cc122-tls-certs\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.089139 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.089053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7dcd51a-a418-41d2-bfd1-23715b6cc122-tmp\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.089139 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.089107 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqbtg\" (UniqueName: \"kubernetes.io/projected/e7dcd51a-a418-41d2-bfd1-23715b6cc122-kube-api-access-lqbtg\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.089139 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.089134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dcd51a-a418-41d2-bfd1-23715b6cc122-tls-certs\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.091426 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.091400 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7dcd51a-a418-41d2-bfd1-23715b6cc122-tmp\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.091599 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.091582 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7dcd51a-a418-41d2-bfd1-23715b6cc122-tls-certs\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.096837 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.096812 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqbtg\" (UniqueName: \"kubernetes.io/projected/e7dcd51a-a418-41d2-bfd1-23715b6cc122-kube-api-access-lqbtg\") pod \"kube-auth-proxy-64889d44f9-9cfx8\" (UID: \"e7dcd51a-a418-41d2-bfd1-23715b6cc122\") " pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.150887 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.150848 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" Jul 06 19:59:20.291016 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:20.290991 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8"] Jul 06 19:59:20.293686 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:59:20.293659 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7dcd51a_a418_41d2_bfd1_23715b6cc122.slice/crio-21da9c7d5c254a8909fee705c27f2ed9dd4551ce8637d0fad08aeebdfcd668ab WatchSource:0}: Error finding container 21da9c7d5c254a8909fee705c27f2ed9dd4551ce8637d0fad08aeebdfcd668ab: Status 404 returned error can't find the container with id 21da9c7d5c254a8909fee705c27f2ed9dd4551ce8637d0fad08aeebdfcd668ab Jul 06 19:59:21.234185 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:21.234146 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" event={"ID":"e7dcd51a-a418-41d2-bfd1-23715b6cc122","Type":"ContainerStarted","Data":"21da9c7d5c254a8909fee705c27f2ed9dd4551ce8637d0fad08aeebdfcd668ab"} Jul 06 19:59:24.252359 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:24.252312 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" event={"ID":"e7dcd51a-a418-41d2-bfd1-23715b6cc122","Type":"ContainerStarted","Data":"fc2d08b61a68e3cfefa981f44a8b1a2c80fa370e7b296c4fe54b3f1edeb70939"} Jul 06 19:59:24.274168 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:24.274118 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-64889d44f9-9cfx8" podStartSLOduration=2.356131853 podStartE2EDuration="5.274101433s" totalImagesPullingTime="2.91796958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:24.271774802 +0000 UTC m=+547.542529108" watchObservedRunningTime="2026-07-06 19:59:24.274101433 +0000 UTC m=+547.544855741" Jul 06 19:59:27.991485 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:27.991446 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn"] Jul 06 19:59:27.994826 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:27.994808 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:27.997628 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:27.997598 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 19:59:27.997628 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:27.997632 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 19:59:27.997839 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:27.997709 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2bfp6\"" Jul 06 19:59:27.997839 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:27.997598 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 19:59:27.997839 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:27.997724 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 19:59:28.019469 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.019426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn"] Jul 06 19:59:28.163232 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.163198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.163392 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.163242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvcgn\" (UniqueName: \"kubernetes.io/projected/4487d4f8-372a-42f4-a52f-cfe308214660-kube-api-access-rvcgn\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.163392 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.163307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4487d4f8-372a-42f4-a52f-cfe308214660-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.163392 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.163337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4487d4f8-372a-42f4-a52f-cfe308214660-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.163392 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.163353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.163392 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.163375 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.163554 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.163450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4487d4f8-372a-42f4-a52f-cfe308214660-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.264414 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.264315 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvcgn\" (UniqueName: \"kubernetes.io/projected/4487d4f8-372a-42f4-a52f-cfe308214660-kube-api-access-rvcgn\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.264414 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.264374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4487d4f8-372a-42f4-a52f-cfe308214660-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.264414 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.264404 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4487d4f8-372a-42f4-a52f-cfe308214660-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.264414 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.264418 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.264791 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.264441 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.264791 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.264461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4487d4f8-372a-42f4-a52f-cfe308214660-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.264791 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.264542 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.265269 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.265240 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4487d4f8-372a-42f4-a52f-cfe308214660-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.267589 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.267559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.267699 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.267565 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4487d4f8-372a-42f4-a52f-cfe308214660-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.267699 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.267608 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.267699 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.267672 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4487d4f8-372a-42f4-a52f-cfe308214660-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.272499 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.272479 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4487d4f8-372a-42f4-a52f-cfe308214660-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.272692 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.272675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvcgn\" (UniqueName: \"kubernetes.io/projected/4487d4f8-372a-42f4-a52f-cfe308214660-kube-api-access-rvcgn\") pod \"istiod-openshift-gateway-94bb8fbfd-rgkzn\" (UID: \"4487d4f8-372a-42f4-a52f-cfe308214660\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.304690 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.304654 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:28.486434 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:28.486407 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn"] Jul 06 19:59:28.489140 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:59:28.489099 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4487d4f8_372a_42f4_a52f_cfe308214660.slice/crio-9776e819b086f2da80c9dd4c5727eb28aef6c1fbcf995485951dece2922b549c WatchSource:0}: Error finding container 9776e819b086f2da80c9dd4c5727eb28aef6c1fbcf995485951dece2922b549c: Status 404 returned error can't find the container with id 9776e819b086f2da80c9dd4c5727eb28aef6c1fbcf995485951dece2922b549c Jul 06 19:59:29.279835 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:29.279769 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" event={"ID":"4487d4f8-372a-42f4-a52f-cfe308214660","Type":"ContainerStarted","Data":"9776e819b086f2da80c9dd4c5727eb28aef6c1fbcf995485951dece2922b549c"} Jul 06 19:59:30.837677 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.837358 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks"] Jul 06 19:59:30.845689 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.845664 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.849559 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.849532 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4vzt6\"" Jul 06 19:59:30.875568 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.875539 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks"] Jul 06 19:59:30.987632 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987586 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.987632 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.987929 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987703 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.987929 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987740 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.987929 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987831 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.987929 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.988130 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvq46\" (UniqueName: \"kubernetes.io/projected/79ee5e1d-3bf0-4f48-bd89-041fca088e36-kube-api-access-wvq46\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.988130 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.987979 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:30.988130 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:30.988011 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090178 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090081 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090178 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090166 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvq46\" (UniqueName: \"kubernetes.io/projected/79ee5e1d-3bf0-4f48-bd89-041fca088e36-kube-api-access-wvq46\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090267 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090413 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090740 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090740 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090539 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.090843 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.090773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.091460 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.091101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.091460 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.091396 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.091668 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.091570 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.094582 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.094557 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.094892 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.094851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.106329 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.106301 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvq46\" (UniqueName: \"kubernetes.io/projected/79ee5e1d-3bf0-4f48-bd89-041fca088e36-kube-api-access-wvq46\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.106976 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.106955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ee5e1d-3bf0-4f48-bd89-041fca088e36-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf47vbks\" (UID: \"79ee5e1d-3bf0-4f48-bd89-041fca088e36\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.160234 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.160204 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:31.195398 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.195346 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:59:31.195500 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.195444 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:59:31.295765 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.295723 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" event={"ID":"4487d4f8-372a-42f4-a52f-cfe308214660","Type":"ContainerStarted","Data":"51a682aac03bacb46629b2b345290da49296466955d6e454698afa1e17773a2f"} Jul 06 19:59:31.296173 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.296120 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:31.318007 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.317950 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" podStartSLOduration=1.6140266680000002 podStartE2EDuration="4.317909531s" totalImagesPullingTime="2.703882863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:31.31667878 +0000 UTC m=+554.587433082" watchObservedRunningTime="2026-07-06 19:59:31.317909531 +0000 UTC m=+554.588663833" Jul 06 19:59:31.325078 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:31.325040 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks"] Jul 06 19:59:31.328667 ip-10-0-135-185 kubenswrapper[2558]: W0706 19:59:31.328626 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ee5e1d_3bf0_4f48_bd89_041fca088e36.slice/crio-af43cef6ed1e1c283b8eaf2181dd7431034ca802ee0ae124cb1522432b220722 WatchSource:0}: Error finding container af43cef6ed1e1c283b8eaf2181dd7431034ca802ee0ae124cb1522432b220722: Status 404 returned error can't find the container with id af43cef6ed1e1c283b8eaf2181dd7431034ca802ee0ae124cb1522432b220722 Jul 06 19:59:32.302653 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:32.302584 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" event={"ID":"79ee5e1d-3bf0-4f48-bd89-041fca088e36","Type":"ContainerStarted","Data":"af43cef6ed1e1c283b8eaf2181dd7431034ca802ee0ae124cb1522432b220722"} Jul 06 19:59:32.304576 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:32.304553 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-rgkzn" Jul 06 19:59:34.821148 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:34.821113 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:59:34.821412 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:34.821184 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:59:34.821412 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:34.821214 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 19:59:35.329037 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:35.328996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" event={"ID":"79ee5e1d-3bf0-4f48-bd89-041fca088e36","Type":"ContainerStarted","Data":"90c4f8872b6f3ed1069617d23343ea43ce763a9496125654a70be57073b2bb0e"} Jul 06 19:59:35.351290 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:35.351240 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" podStartSLOduration=1.860913759 podStartE2EDuration="5.351225021s" totalImagesPullingTime="3.490311262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:59:35.349536745 +0000 UTC m=+558.620291048" watchObservedRunningTime="2026-07-06 19:59:35.351225021 +0000 UTC m=+558.621979322" Jul 06 19:59:36.160680 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:36.160625 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:36.165143 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:36.165118 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:36.333541 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:36.333500 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 19:59:36.334452 ip-10-0-135-185 kubenswrapper[2558]: I0706 19:59:36.334429 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf47vbks" Jul 06 20:00:17.146226 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:17.146195 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:00:17.147406 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:17.147384 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:00:20.436183 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.436147 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tf67"] Jul 06 20:00:20.439400 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.439381 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" Jul 06 20:00:20.442092 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.441909 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 20:00:20.442092 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.441986 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 20:00:20.442918 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.442895 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xwgmz\"" Jul 06 20:00:20.449097 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.449075 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tf67"] Jul 06 20:00:20.538281 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.538247 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4r5w\" (UniqueName: \"kubernetes.io/projected/1bfa1106-a52a-4281-9320-a2f6a5cc2648-kube-api-access-q4r5w\") pod \"kuadrant-operator-catalog-6tf67\" (UID: \"1bfa1106-a52a-4281-9320-a2f6a5cc2648\") " pod="kuadrant-system/kuadrant-operator-catalog-6tf67" Jul 06 20:00:20.639550 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.639508 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4r5w\" (UniqueName: \"kubernetes.io/projected/1bfa1106-a52a-4281-9320-a2f6a5cc2648-kube-api-access-q4r5w\") pod \"kuadrant-operator-catalog-6tf67\" (UID: \"1bfa1106-a52a-4281-9320-a2f6a5cc2648\") " pod="kuadrant-system/kuadrant-operator-catalog-6tf67" Jul 06 20:00:20.647722 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.647689 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4r5w\" (UniqueName: \"kubernetes.io/projected/1bfa1106-a52a-4281-9320-a2f6a5cc2648-kube-api-access-q4r5w\") pod \"kuadrant-operator-catalog-6tf67\" (UID: \"1bfa1106-a52a-4281-9320-a2f6a5cc2648\") " pod="kuadrant-system/kuadrant-operator-catalog-6tf67" Jul 06 20:00:20.750208 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.750117 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" Jul 06 20:00:20.807372 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.807344 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tf67"] Jul 06 20:00:20.882217 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:20.882192 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tf67"] Jul 06 20:00:20.884339 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:00:20.884309 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bfa1106_a52a_4281_9320_a2f6a5cc2648.slice/crio-9809ebc2be0d8ff707efdb0c8cecd1fecfd11cf251fdc412bdfbb3b21cdca922 WatchSource:0}: Error finding container 9809ebc2be0d8ff707efdb0c8cecd1fecfd11cf251fdc412bdfbb3b21cdca922: Status 404 returned error can't find the container with id 9809ebc2be0d8ff707efdb0c8cecd1fecfd11cf251fdc412bdfbb3b21cdca922 Jul 06 20:00:21.014815 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.014729 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mb82v"] Jul 06 20:00:21.018152 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.018130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:21.026372 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.026351 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mb82v"] Jul 06 20:00:21.042732 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.042702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxctz\" (UniqueName: \"kubernetes.io/projected/5cb1ff06-e996-47e5-ab50-05c996325195-kube-api-access-xxctz\") pod \"kuadrant-operator-catalog-mb82v\" (UID: \"5cb1ff06-e996-47e5-ab50-05c996325195\") " pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:21.143800 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.143772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxctz\" (UniqueName: \"kubernetes.io/projected/5cb1ff06-e996-47e5-ab50-05c996325195-kube-api-access-xxctz\") pod \"kuadrant-operator-catalog-mb82v\" (UID: \"5cb1ff06-e996-47e5-ab50-05c996325195\") " pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:21.155312 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.155289 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxctz\" (UniqueName: \"kubernetes.io/projected/5cb1ff06-e996-47e5-ab50-05c996325195-kube-api-access-xxctz\") pod \"kuadrant-operator-catalog-mb82v\" (UID: \"5cb1ff06-e996-47e5-ab50-05c996325195\") " pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:21.329324 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.329247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:21.479761 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.479729 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mb82v"] Jul 06 20:00:21.495412 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.495390 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:00:21.546318 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.546281 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" event={"ID":"1bfa1106-a52a-4281-9320-a2f6a5cc2648","Type":"ContainerStarted","Data":"9809ebc2be0d8ff707efdb0c8cecd1fecfd11cf251fdc412bdfbb3b21cdca922"} Jul 06 20:00:21.547606 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:21.547578 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" event={"ID":"5cb1ff06-e996-47e5-ab50-05c996325195","Type":"ContainerStarted","Data":"e03c12667a1dc44dfd3afecfe7c2b4b11bba5bd7a54af9a5076787836c68afc5"} Jul 06 20:00:23.561629 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.561587 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" event={"ID":"1bfa1106-a52a-4281-9320-a2f6a5cc2648","Type":"ContainerStarted","Data":"374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b"} Jul 06 20:00:23.562088 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.561666 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" podUID="1bfa1106-a52a-4281-9320-a2f6a5cc2648" containerName="registry-server" containerID="cri-o://374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b" gracePeriod=2 Jul 06 20:00:23.563105 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.563084 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" event={"ID":"5cb1ff06-e996-47e5-ab50-05c996325195","Type":"ContainerStarted","Data":"9dd9d23b8fcefda12b479b6a7145d2affa3440d359f1d5a238dadea30f247ca0"} Jul 06 20:00:23.582919 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.582847 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" podStartSLOduration=1.12996588 podStartE2EDuration="3.582831028s" totalImagesPullingTime="2.452865148s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:23.581161081 +0000 UTC m=+606.851915394" watchObservedRunningTime="2026-07-06 20:00:23.582831028 +0000 UTC m=+606.853585328" Jul 06 20:00:23.597698 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.597614 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" podStartSLOduration=1.751512622 podStartE2EDuration="3.5975961s" totalImagesPullingTime="1.846083478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:23.597319848 +0000 UTC m=+606.868074149" watchObservedRunningTime="2026-07-06 20:00:23.5975961 +0000 UTC m=+606.868350400" Jul 06 20:00:23.831012 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.830982 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" Jul 06 20:00:23.869117 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.869034 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4r5w\" (UniqueName: \"kubernetes.io/projected/1bfa1106-a52a-4281-9320-a2f6a5cc2648-kube-api-access-q4r5w\") pod \"1bfa1106-a52a-4281-9320-a2f6a5cc2648\" (UID: \"1bfa1106-a52a-4281-9320-a2f6a5cc2648\") " Jul 06 20:00:23.871162 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.871137 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bfa1106-a52a-4281-9320-a2f6a5cc2648-kube-api-access-q4r5w" (OuterVolumeSpecName: "kube-api-access-q4r5w") pod "1bfa1106-a52a-4281-9320-a2f6a5cc2648" (UID: "1bfa1106-a52a-4281-9320-a2f6a5cc2648"). InnerVolumeSpecName "kube-api-access-q4r5w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:00:23.969805 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:23.969757 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4r5w\" (UniqueName: \"kubernetes.io/projected/1bfa1106-a52a-4281-9320-a2f6a5cc2648-kube-api-access-q4r5w\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:00:24.568549 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.568516 2558 generic.go:356] "Generic (PLEG): container finished" podID="1bfa1106-a52a-4281-9320-a2f6a5cc2648" containerID="374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b" exitCode=0 Jul 06 20:00:24.569069 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.568567 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" Jul 06 20:00:24.569069 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.568601 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" event={"ID":"1bfa1106-a52a-4281-9320-a2f6a5cc2648","Type":"ContainerDied","Data":"374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b"} Jul 06 20:00:24.569069 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.568677 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6tf67" event={"ID":"1bfa1106-a52a-4281-9320-a2f6a5cc2648","Type":"ContainerDied","Data":"9809ebc2be0d8ff707efdb0c8cecd1fecfd11cf251fdc412bdfbb3b21cdca922"} Jul 06 20:00:24.569069 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.568692 2558 scope.go:117] "RemoveContainer" containerID="374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b" Jul 06 20:00:24.577997 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.577979 2558 scope.go:117] "RemoveContainer" containerID="374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b" Jul 06 20:00:24.578232 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:00:24.578212 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b\": container with ID starting with 374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b not found: ID does not exist" containerID="374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b" Jul 06 20:00:24.578274 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.578239 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b"} err="failed to get container status \"374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b\": rpc error: code = NotFound desc = could not find container \"374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b\": container with ID starting with 374ae19c92149cfa2b043fd2106b750e3c388e926412293632aef37192054c7b not found: ID does not exist" Jul 06 20:00:24.589534 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.589510 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tf67"] Jul 06 20:00:24.592932 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:24.592914 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6tf67"] Jul 06 20:00:25.320710 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:25.320677 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bfa1106-a52a-4281-9320-a2f6a5cc2648" path="/var/lib/kubelet/pods/1bfa1106-a52a-4281-9320-a2f6a5cc2648/volumes" Jul 06 20:00:31.329910 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:31.329882 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:31.330324 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:31.329937 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:31.352184 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:31.352140 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:31.623883 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:31.623810 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mb82v" Jul 06 20:00:52.222620 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.222539 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv"] Jul 06 20:00:52.223103 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.222925 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bfa1106-a52a-4281-9320-a2f6a5cc2648" containerName="registry-server" Jul 06 20:00:52.223103 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.222938 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfa1106-a52a-4281-9320-a2f6a5cc2648" containerName="registry-server" Jul 06 20:00:52.223103 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.223015 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bfa1106-a52a-4281-9320-a2f6a5cc2648" containerName="registry-server" Jul 06 20:00:52.229347 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.229332 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" Jul 06 20:00:52.232976 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.232955 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6dq2f\"" Jul 06 20:00:52.233094 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.232997 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 20:00:52.239765 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.239741 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv"] Jul 06 20:00:52.322277 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.322247 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szrkf\" (UniqueName: \"kubernetes.io/projected/bec241d9-1529-4463-ae39-20ccc8f824d0-kube-api-access-szrkf\") pod \"dns-operator-controller-manager-864dd78c4c-kmkdv\" (UID: \"bec241d9-1529-4463-ae39-20ccc8f824d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" Jul 06 20:00:52.423172 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.423125 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szrkf\" (UniqueName: \"kubernetes.io/projected/bec241d9-1529-4463-ae39-20ccc8f824d0-kube-api-access-szrkf\") pod \"dns-operator-controller-manager-864dd78c4c-kmkdv\" (UID: \"bec241d9-1529-4463-ae39-20ccc8f824d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" Jul 06 20:00:52.433566 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.433535 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szrkf\" (UniqueName: \"kubernetes.io/projected/bec241d9-1529-4463-ae39-20ccc8f824d0-kube-api-access-szrkf\") pod \"dns-operator-controller-manager-864dd78c4c-kmkdv\" (UID: \"bec241d9-1529-4463-ae39-20ccc8f824d0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" Jul 06 20:00:52.540051 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.539973 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" Jul 06 20:00:52.674416 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.674388 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv"] Jul 06 20:00:52.676900 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:00:52.676873 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec241d9_1529_4463_ae39_20ccc8f824d0.slice/crio-930af2b26021f479e444ef6fc7f07bdd1253b7140aa7a5385d4e13504f43be26 WatchSource:0}: Error finding container 930af2b26021f479e444ef6fc7f07bdd1253b7140aa7a5385d4e13504f43be26: Status 404 returned error can't find the container with id 930af2b26021f479e444ef6fc7f07bdd1253b7140aa7a5385d4e13504f43be26 Jul 06 20:00:52.708318 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:52.708279 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" event={"ID":"bec241d9-1529-4463-ae39-20ccc8f824d0","Type":"ContainerStarted","Data":"930af2b26021f479e444ef6fc7f07bdd1253b7140aa7a5385d4e13504f43be26"} Jul 06 20:00:55.724010 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:55.723970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" event={"ID":"bec241d9-1529-4463-ae39-20ccc8f824d0","Type":"ContainerStarted","Data":"52cfba96b46c30ed90bac7767b0b92d46ad723109dd95fcfe1891d8769d125c4"} Jul 06 20:00:55.724453 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:55.724076 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" Jul 06 20:00:55.742292 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:55.742248 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" podStartSLOduration=1.659377896 podStartE2EDuration="3.742233853s" totalImagesPullingTime="2.082855957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:55.740602773 +0000 UTC m=+639.011357095" watchObservedRunningTime="2026-07-06 20:00:55.742233853 +0000 UTC m=+639.012988154" Jul 06 20:00:56.277858 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.277823 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz"] Jul 06 20:00:56.281381 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.281356 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" Jul 06 20:00:56.283922 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.283900 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t8gng\"" Jul 06 20:00:56.294728 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.294706 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz"] Jul 06 20:00:56.459398 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.459366 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8zk\" (UniqueName: \"kubernetes.io/projected/ac488e4c-75a1-4b48-a6df-ccd615d7f3d2-kube-api-access-rx8zk\") pod \"authorino-operator-75cc8d5cb7-dkpfz\" (UID: \"ac488e4c-75a1-4b48-a6df-ccd615d7f3d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" Jul 06 20:00:56.560124 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.560080 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8zk\" (UniqueName: \"kubernetes.io/projected/ac488e4c-75a1-4b48-a6df-ccd615d7f3d2-kube-api-access-rx8zk\") pod \"authorino-operator-75cc8d5cb7-dkpfz\" (UID: \"ac488e4c-75a1-4b48-a6df-ccd615d7f3d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" Jul 06 20:00:56.572272 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.572248 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8zk\" (UniqueName: \"kubernetes.io/projected/ac488e4c-75a1-4b48-a6df-ccd615d7f3d2-kube-api-access-rx8zk\") pod \"authorino-operator-75cc8d5cb7-dkpfz\" (UID: \"ac488e4c-75a1-4b48-a6df-ccd615d7f3d2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" Jul 06 20:00:56.591301 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.591279 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" Jul 06 20:00:56.727267 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:56.727243 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz"] Jul 06 20:00:56.729392 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:00:56.729367 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac488e4c_75a1_4b48_a6df_ccd615d7f3d2.slice/crio-7e48452018d493cd65329b1d50cfdaf16de015baeb4945c888f5c303956c0ef0 WatchSource:0}: Error finding container 7e48452018d493cd65329b1d50cfdaf16de015baeb4945c888f5c303956c0ef0: Status 404 returned error can't find the container with id 7e48452018d493cd65329b1d50cfdaf16de015baeb4945c888f5c303956c0ef0 Jul 06 20:00:57.739119 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:57.739075 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" event={"ID":"ac488e4c-75a1-4b48-a6df-ccd615d7f3d2","Type":"ContainerStarted","Data":"7e48452018d493cd65329b1d50cfdaf16de015baeb4945c888f5c303956c0ef0"} Jul 06 20:00:59.753740 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:59.753698 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" event={"ID":"ac488e4c-75a1-4b48-a6df-ccd615d7f3d2","Type":"ContainerStarted","Data":"b6de8e870a02dc7ebf6e980f2d6f50e46dd871203db226198481704dfc3a5379"} Jul 06 20:00:59.754162 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:59.753843 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" Jul 06 20:00:59.773582 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:00:59.773524 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" podStartSLOduration=1.302199179 podStartE2EDuration="3.77350828s" totalImagesPullingTime="2.471309101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:59.772767243 +0000 UTC m=+643.043521549" watchObservedRunningTime="2026-07-06 20:00:59.77350828 +0000 UTC m=+643.044262584" Jul 06 20:01:03.994362 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:03.994325 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7"] Jul 06 20:01:03.998291 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:03.998268 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:04.000915 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.000892 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wbqwq\"" Jul 06 20:01:04.008154 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.008128 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7"] Jul 06 20:01:04.032274 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.032242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kfwc\" (UniqueName: \"kubernetes.io/projected/e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9-kube-api-access-8kfwc\") pod \"limitador-operator-controller-manager-859d7b78bd-wxwf7\" (UID: \"e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:04.133631 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.133598 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kfwc\" (UniqueName: \"kubernetes.io/projected/e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9-kube-api-access-8kfwc\") pod \"limitador-operator-controller-manager-859d7b78bd-wxwf7\" (UID: \"e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:04.144457 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.144437 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kfwc\" (UniqueName: \"kubernetes.io/projected/e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9-kube-api-access-8kfwc\") pod \"limitador-operator-controller-manager-859d7b78bd-wxwf7\" (UID: \"e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:04.308897 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.308796 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:04.450141 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.450105 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7"] Jul 06 20:01:04.454263 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:01:04.454236 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d3341c_c93b_4c3e_9bbf_4b280f18c8c9.slice/crio-2275f3c384d8ee817e59fa38a023d0140b903e80bef18030deb6ad08ec278bb8 WatchSource:0}: Error finding container 2275f3c384d8ee817e59fa38a023d0140b903e80bef18030deb6ad08ec278bb8: Status 404 returned error can't find the container with id 2275f3c384d8ee817e59fa38a023d0140b903e80bef18030deb6ad08ec278bb8 Jul 06 20:01:04.779198 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:04.779154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" event={"ID":"e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9","Type":"ContainerStarted","Data":"2275f3c384d8ee817e59fa38a023d0140b903e80bef18030deb6ad08ec278bb8"} Jul 06 20:01:06.733412 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:06.733384 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kmkdv" Jul 06 20:01:07.796188 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:07.796152 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" event={"ID":"e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9","Type":"ContainerStarted","Data":"e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501"} Jul 06 20:01:07.796629 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:07.796212 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:07.812653 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:07.812591 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" podStartSLOduration=2.52197803 podStartE2EDuration="4.812572924s" totalImagesPullingTime="2.290594894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:07.812198855 +0000 UTC m=+651.082953157" watchObservedRunningTime="2026-07-06 20:01:07.812572924 +0000 UTC m=+651.083327227" Jul 06 20:01:10.761180 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:10.761145 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dkpfz" Jul 06 20:01:18.805791 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:18.805762 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:20.327533 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.327498 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp"] Jul 06 20:01:20.332371 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.332346 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.335627 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.335596 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kvfcs\"" Jul 06 20:01:20.341703 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.341675 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7"] Jul 06 20:01:20.342101 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.342051 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" containerName="manager" containerID="cri-o://e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501" gracePeriod=2 Jul 06 20:01:20.356365 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.356313 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7"] Jul 06 20:01:20.358965 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.358938 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp"] Jul 06 20:01:20.374319 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.374291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n8ww\" (UniqueName: \"kubernetes.io/projected/20688917-006d-4eb0-829f-1c3b4a03e707-kube-api-access-7n8ww\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sltnp\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.374414 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.374344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20688917-006d-4eb0-829f-1c3b4a03e707-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sltnp\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.381206 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:01:20.381170 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wxwf7\" is forbidden: User \"system:node:ip-10-0-135-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-185.ec2.internal' and this object" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:20.475096 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.475064 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n8ww\" (UniqueName: \"kubernetes.io/projected/20688917-006d-4eb0-829f-1c3b4a03e707-kube-api-access-7n8ww\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sltnp\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.475280 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.475103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20688917-006d-4eb0-829f-1c3b4a03e707-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sltnp\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.475469 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.475444 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20688917-006d-4eb0-829f-1c3b4a03e707-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sltnp\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.484178 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.484146 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n8ww\" (UniqueName: \"kubernetes.io/projected/20688917-006d-4eb0-829f-1c3b4a03e707-kube-api-access-7n8ww\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sltnp\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.586110 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.586051 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:20.588473 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:01:20.588446 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wxwf7\" is forbidden: User \"system:node:ip-10-0-135-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-185.ec2.internal' and this object" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:20.645943 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.645918 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:20.676869 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.676838 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kfwc\" (UniqueName: \"kubernetes.io/projected/e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9-kube-api-access-8kfwc\") pod \"e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9\" (UID: \"e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9\") " Jul 06 20:01:20.678832 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.678806 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9-kube-api-access-8kfwc" (OuterVolumeSpecName: "kube-api-access-8kfwc") pod "e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" (UID: "e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9"). InnerVolumeSpecName "kube-api-access-8kfwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:01:20.777866 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.777834 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kfwc\" (UniqueName: \"kubernetes.io/projected/e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9-kube-api-access-8kfwc\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:01:20.783000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.782977 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp"] Jul 06 20:01:20.785071 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:01:20.785041 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20688917_006d_4eb0_829f_1c3b4a03e707.slice/crio-99981c786c302ea4fa2347f8d37ccac2b6c48efbce1fbe3eeb7d74f5d593afbc WatchSource:0}: Error finding container 99981c786c302ea4fa2347f8d37ccac2b6c48efbce1fbe3eeb7d74f5d593afbc: Status 404 returned error can't find the container with id 99981c786c302ea4fa2347f8d37ccac2b6c48efbce1fbe3eeb7d74f5d593afbc Jul 06 20:01:20.865622 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.865528 2558 generic.go:356] "Generic (PLEG): container finished" podID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" containerID="e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501" exitCode=0 Jul 06 20:01:20.865622 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.865573 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:20.865879 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.865628 2558 scope.go:117] "RemoveContainer" containerID="e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501" Jul 06 20:01:20.867138 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.867109 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" event={"ID":"20688917-006d-4eb0-829f-1c3b4a03e707","Type":"ContainerStarted","Data":"99981c786c302ea4fa2347f8d37ccac2b6c48efbce1fbe3eeb7d74f5d593afbc"} Jul 06 20:01:20.868217 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:01:20.868187 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wxwf7\" is forbidden: User \"system:node:ip-10-0-135-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-185.ec2.internal' and this object" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:20.875288 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.875270 2558 scope.go:117] "RemoveContainer" containerID="e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501" Jul 06 20:01:20.875556 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:01:20.875537 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501\": container with ID starting with e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501 not found: ID does not exist" containerID="e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501" Jul 06 20:01:20.875608 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:20.875561 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501"} err="failed to get container status \"e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501\": rpc error: code = NotFound desc = could not find container \"e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501\": container with ID starting with e493e6860c0ab62c3654316c7f17cc0385ba6ed3dfd4c6bada39d24f7234a501 not found: ID does not exist" Jul 06 20:01:20.877791 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:01:20.877767 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wxwf7\" is forbidden: User \"system:node:ip-10-0-135-185.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-185.ec2.internal' and this object" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wxwf7" Jul 06 20:01:21.321500 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:21.321469 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" path="/var/lib/kubelet/pods/e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9/volumes" Jul 06 20:01:26.903079 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:26.903037 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" event={"ID":"20688917-006d-4eb0-829f-1c3b4a03e707","Type":"ContainerStarted","Data":"52a181cd1d5179fba3882018d94f97a937740cfa2e77f20e8f2fd37c55d475ce"} Jul 06 20:01:26.903533 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:26.903110 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:26.925888 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:26.925838 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" podStartSLOduration=1.33675459 podStartE2EDuration="6.925820516s" totalImagesPullingTime="5.589065926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:26.925033352 +0000 UTC m=+670.195787655" watchObservedRunningTime="2026-07-06 20:01:26.925820516 +0000 UTC m=+670.196574819" Jul 06 20:01:32.733200 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:32.733167 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp"] Jul 06 20:01:32.733616 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:32.733342 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" podUID="20688917-006d-4eb0-829f-1c3b4a03e707" containerName="manager" containerID="cri-o://52a181cd1d5179fba3882018d94f97a937740cfa2e77f20e8f2fd37c55d475ce" gracePeriod=10 Jul 06 20:01:32.735212 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:32.735189 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:32.935962 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:32.935923 2558 generic.go:356] "Generic (PLEG): container finished" podID="20688917-006d-4eb0-829f-1c3b4a03e707" containerID="52a181cd1d5179fba3882018d94f97a937740cfa2e77f20e8f2fd37c55d475ce" exitCode=0 Jul 06 20:01:32.936111 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:32.935981 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" event={"ID":"20688917-006d-4eb0-829f-1c3b4a03e707","Type":"ContainerDied","Data":"52a181cd1d5179fba3882018d94f97a937740cfa2e77f20e8f2fd37c55d475ce"} Jul 06 20:01:32.990219 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:32.990158 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:33.086730 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.086697 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20688917-006d-4eb0-829f-1c3b4a03e707-extensions-socket-volume\") pod \"20688917-006d-4eb0-829f-1c3b4a03e707\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " Jul 06 20:01:33.086874 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.086823 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n8ww\" (UniqueName: \"kubernetes.io/projected/20688917-006d-4eb0-829f-1c3b4a03e707-kube-api-access-7n8ww\") pod \"20688917-006d-4eb0-829f-1c3b4a03e707\" (UID: \"20688917-006d-4eb0-829f-1c3b4a03e707\") " Jul 06 20:01:33.087252 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.087229 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20688917-006d-4eb0-829f-1c3b4a03e707-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "20688917-006d-4eb0-829f-1c3b4a03e707" (UID: "20688917-006d-4eb0-829f-1c3b4a03e707"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:01:33.088918 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.088888 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20688917-006d-4eb0-829f-1c3b4a03e707-kube-api-access-7n8ww" (OuterVolumeSpecName: "kube-api-access-7n8ww") pod "20688917-006d-4eb0-829f-1c3b4a03e707" (UID: "20688917-006d-4eb0-829f-1c3b4a03e707"). InnerVolumeSpecName "kube-api-access-7n8ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:01:33.187917 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.187889 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/20688917-006d-4eb0-829f-1c3b4a03e707-extensions-socket-volume\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:01:33.187917 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.187913 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n8ww\" (UniqueName: \"kubernetes.io/projected/20688917-006d-4eb0-829f-1c3b4a03e707-kube-api-access-7n8ww\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:01:33.942839 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.942800 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" event={"ID":"20688917-006d-4eb0-829f-1c3b4a03e707","Type":"ContainerDied","Data":"99981c786c302ea4fa2347f8d37ccac2b6c48efbce1fbe3eeb7d74f5d593afbc"} Jul 06 20:01:33.942839 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.942829 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp" Jul 06 20:01:33.943318 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.942875 2558 scope.go:117] "RemoveContainer" containerID="52a181cd1d5179fba3882018d94f97a937740cfa2e77f20e8f2fd37c55d475ce" Jul 06 20:01:33.969449 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.969415 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp"] Jul 06 20:01:33.975672 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:33.973248 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sltnp"] Jul 06 20:01:35.320633 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:35.320601 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20688917-006d-4eb0-829f-1c3b4a03e707" path="/var/lib/kubelet/pods/20688917-006d-4eb0-829f-1c3b4a03e707/volumes" Jul 06 20:01:49.045114 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.045069 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm"] Jul 06 20:01:49.045667 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.045632 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" containerName="manager" Jul 06 20:01:49.045667 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.045667 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" containerName="manager" Jul 06 20:01:49.045794 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.045697 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20688917-006d-4eb0-829f-1c3b4a03e707" containerName="manager" Jul 06 20:01:49.045794 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.045705 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="20688917-006d-4eb0-829f-1c3b4a03e707" containerName="manager" Jul 06 20:01:49.045860 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.045796 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8d3341c-c93b-4c3e-9bbf-4b280f18c8c9" containerName="manager" Jul 06 20:01:49.045860 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.045805 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="20688917-006d-4eb0-829f-1c3b4a03e707" containerName="manager" Jul 06 20:01:49.048173 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.048154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.050803 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.050781 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fj4xv\"" Jul 06 20:01:49.065008 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.064986 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm"] Jul 06 20:01:49.237718 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.237681 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.237938 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.237739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67011710-a339-4f0d-949b-eb210557c3d1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.237938 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.237758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67011710-a339-4f0d-949b-eb210557c3d1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.237938 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.237833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4sps\" (UniqueName: \"kubernetes.io/projected/67011710-a339-4f0d-949b-eb210557c3d1-kube-api-access-r4sps\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.237938 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.237891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.237938 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.237920 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.238186 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.237980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67011710-a339-4f0d-949b-eb210557c3d1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.238186 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.238036 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.238186 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.238066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.338770 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.338683 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4sps\" (UniqueName: \"kubernetes.io/projected/67011710-a339-4f0d-949b-eb210557c3d1-kube-api-access-r4sps\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.338770 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.338732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.338999 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.338757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.338999 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.338838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67011710-a339-4f0d-949b-eb210557c3d1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.338999 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.338886 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.338999 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.338911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.338999 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.338968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.339259 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.339010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67011710-a339-4f0d-949b-eb210557c3d1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.339259 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.339040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67011710-a339-4f0d-949b-eb210557c3d1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.339585 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.339471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.339585 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.339546 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.339776 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.339585 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.339776 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.339597 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.339776 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.339720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67011710-a339-4f0d-949b-eb210557c3d1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.341062 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.341041 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67011710-a339-4f0d-949b-eb210557c3d1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.341464 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.341449 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67011710-a339-4f0d-949b-eb210557c3d1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.346445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.346423 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4sps\" (UniqueName: \"kubernetes.io/projected/67011710-a339-4f0d-949b-eb210557c3d1-kube-api-access-r4sps\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.346445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.346437 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67011710-a339-4f0d-949b-eb210557c3d1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-bznwm\" (UID: \"67011710-a339-4f0d-949b-eb210557c3d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.358525 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.358500 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:49.519509 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.519482 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm"] Jul 06 20:01:49.521279 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:01:49.521249 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67011710_a339_4f0d_949b_eb210557c3d1.slice/crio-89b122907763795d825c140f936e1700ca25a6a9163316b796a84f7361c96c92 WatchSource:0}: Error finding container 89b122907763795d825c140f936e1700ca25a6a9163316b796a84f7361c96c92: Status 404 returned error can't find the container with id 89b122907763795d825c140f936e1700ca25a6a9163316b796a84f7361c96c92 Jul 06 20:01:49.523350 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.523319 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:01:49.523414 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.523385 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:01:49.523459 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:49.523416 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:01:50.024931 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:50.024888 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" event={"ID":"67011710-a339-4f0d-949b-eb210557c3d1","Type":"ContainerStarted","Data":"af4c5a092dc62f8b1eae02108903e096bd46ff9c6e9705dc57e9cdec662acf56"} Jul 06 20:01:50.025112 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:50.024955 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" event={"ID":"67011710-a339-4f0d-949b-eb210557c3d1","Type":"ContainerStarted","Data":"89b122907763795d825c140f936e1700ca25a6a9163316b796a84f7361c96c92"} Jul 06 20:01:50.049570 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:50.049521 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" podStartSLOduration=1.049506532 podStartE2EDuration="1.049506532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:01:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:01:50.049104696 +0000 UTC m=+693.319858998" watchObservedRunningTime="2026-07-06 20:01:50.049506532 +0000 UTC m=+693.320260833" Jul 06 20:01:50.359565 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:50.359490 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:50.364073 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:50.364049 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:51.030220 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:51.030193 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:01:51.031309 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:01:51.031287 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:02:05.962848 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:05.962811 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2sqx9"] Jul 06 20:02:05.965466 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:05.965450 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:05.967991 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:05.967961 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 20:02:05.968136 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:05.968005 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2dsqm\"" Jul 06 20:02:05.974070 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:05.974048 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2sqx9"] Jul 06 20:02:06.060577 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.060542 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2sqx9"] Jul 06 20:02:06.067458 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.067417 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce99d595-c70e-481f-b574-46e04926a253-config-file\") pod \"limitador-limitador-64c94fd64f-2sqx9\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:06.067622 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.067500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l9g7\" (UniqueName: \"kubernetes.io/projected/ce99d595-c70e-481f-b574-46e04926a253-kube-api-access-4l9g7\") pod \"limitador-limitador-64c94fd64f-2sqx9\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:06.168399 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.168359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce99d595-c70e-481f-b574-46e04926a253-config-file\") pod \"limitador-limitador-64c94fd64f-2sqx9\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:06.168590 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.168439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l9g7\" (UniqueName: \"kubernetes.io/projected/ce99d595-c70e-481f-b574-46e04926a253-kube-api-access-4l9g7\") pod \"limitador-limitador-64c94fd64f-2sqx9\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:06.169210 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.169184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce99d595-c70e-481f-b574-46e04926a253-config-file\") pod \"limitador-limitador-64c94fd64f-2sqx9\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:06.178854 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.178821 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l9g7\" (UniqueName: \"kubernetes.io/projected/ce99d595-c70e-481f-b574-46e04926a253-kube-api-access-4l9g7\") pod \"limitador-limitador-64c94fd64f-2sqx9\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:06.276848 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.276767 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:06.411094 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:06.411069 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2sqx9"] Jul 06 20:02:06.413163 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:02:06.413139 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce99d595_c70e_481f_b574_46e04926a253.slice/crio-a3cf79b86141d4ed298804d59cca78447f66c375228ad42e2cdc7c3e01520eea WatchSource:0}: Error finding container a3cf79b86141d4ed298804d59cca78447f66c375228ad42e2cdc7c3e01520eea: Status 404 returned error can't find the container with id a3cf79b86141d4ed298804d59cca78447f66c375228ad42e2cdc7c3e01520eea Jul 06 20:02:07.118772 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:07.118739 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" event={"ID":"ce99d595-c70e-481f-b574-46e04926a253","Type":"ContainerStarted","Data":"a3cf79b86141d4ed298804d59cca78447f66c375228ad42e2cdc7c3e01520eea"} Jul 06 20:02:10.136154 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:10.136116 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" event={"ID":"ce99d595-c70e-481f-b574-46e04926a253","Type":"ContainerStarted","Data":"15b4be70e688dbc51b03d0b34d8d48c53c97d5d1ae8264b0beca8f9e8a38b14c"} Jul 06 20:02:10.136535 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:10.136245 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:10.154806 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:10.154760 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" podStartSLOduration=2.309503785 podStartE2EDuration="5.154746769s" totalImagesPullingTime="2.845242984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:10.152449657 +0000 UTC m=+713.423203959" watchObservedRunningTime="2026-07-06 20:02:10.154746769 +0000 UTC m=+713.425501070" Jul 06 20:02:21.142497 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:21.142463 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:23.781686 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:23.781650 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2sqx9"] Jul 06 20:02:23.782151 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:23.781828 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" podUID="ce99d595-c70e-481f-b574-46e04926a253" containerName="limitador" containerID="cri-o://15b4be70e688dbc51b03d0b34d8d48c53c97d5d1ae8264b0beca8f9e8a38b14c" gracePeriod=30 Jul 06 20:02:24.208721 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.208689 2558 generic.go:356] "Generic (PLEG): container finished" podID="ce99d595-c70e-481f-b574-46e04926a253" containerID="15b4be70e688dbc51b03d0b34d8d48c53c97d5d1ae8264b0beca8f9e8a38b14c" exitCode=0 Jul 06 20:02:24.208855 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.208753 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" event={"ID":"ce99d595-c70e-481f-b574-46e04926a253","Type":"ContainerDied","Data":"15b4be70e688dbc51b03d0b34d8d48c53c97d5d1ae8264b0beca8f9e8a38b14c"} Jul 06 20:02:24.336381 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.336357 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:24.439793 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.439765 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce99d595-c70e-481f-b574-46e04926a253-config-file\") pod \"ce99d595-c70e-481f-b574-46e04926a253\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " Jul 06 20:02:24.439954 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.439874 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l9g7\" (UniqueName: \"kubernetes.io/projected/ce99d595-c70e-481f-b574-46e04926a253-kube-api-access-4l9g7\") pod \"ce99d595-c70e-481f-b574-46e04926a253\" (UID: \"ce99d595-c70e-481f-b574-46e04926a253\") " Jul 06 20:02:24.440078 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.440061 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce99d595-c70e-481f-b574-46e04926a253-config-file" (OuterVolumeSpecName: "config-file") pod "ce99d595-c70e-481f-b574-46e04926a253" (UID: "ce99d595-c70e-481f-b574-46e04926a253"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:02:24.441883 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.441859 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce99d595-c70e-481f-b574-46e04926a253-kube-api-access-4l9g7" (OuterVolumeSpecName: "kube-api-access-4l9g7") pod "ce99d595-c70e-481f-b574-46e04926a253" (UID: "ce99d595-c70e-481f-b574-46e04926a253"). InnerVolumeSpecName "kube-api-access-4l9g7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:02:24.541502 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.541461 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ce99d595-c70e-481f-b574-46e04926a253-config-file\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:02:24.541502 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:24.541496 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l9g7\" (UniqueName: \"kubernetes.io/projected/ce99d595-c70e-481f-b574-46e04926a253-kube-api-access-4l9g7\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:02:25.214874 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:25.214842 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" event={"ID":"ce99d595-c70e-481f-b574-46e04926a253","Type":"ContainerDied","Data":"a3cf79b86141d4ed298804d59cca78447f66c375228ad42e2cdc7c3e01520eea"} Jul 06 20:02:25.215360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:25.214903 2558 scope.go:117] "RemoveContainer" containerID="15b4be70e688dbc51b03d0b34d8d48c53c97d5d1ae8264b0beca8f9e8a38b14c" Jul 06 20:02:25.215360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:25.214849 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-2sqx9" Jul 06 20:02:25.235845 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:25.235816 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2sqx9"] Jul 06 20:02:25.239569 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:25.239546 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-2sqx9"] Jul 06 20:02:25.320565 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:25.320534 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce99d595-c70e-481f-b574-46e04926a253" path="/var/lib/kubelet/pods/ce99d595-c70e-481f-b574-46e04926a253/volumes" Jul 06 20:02:27.946410 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.946378 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-mcsxz"] Jul 06 20:02:27.946819 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.946787 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce99d595-c70e-481f-b574-46e04926a253" containerName="limitador" Jul 06 20:02:27.946819 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.946798 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce99d595-c70e-481f-b574-46e04926a253" containerName="limitador" Jul 06 20:02:27.946909 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.946878 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce99d595-c70e-481f-b574-46e04926a253" containerName="limitador" Jul 06 20:02:27.951411 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.951390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:27.953782 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.953762 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 06 20:02:27.953902 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.953772 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pd4r2\"" Jul 06 20:02:27.958800 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:27.958777 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mcsxz"] Jul 06 20:02:28.074570 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.074534 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm78g\" (UniqueName: \"kubernetes.io/projected/729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec-kube-api-access-nm78g\") pod \"postgres-69fb4594cf-mcsxz\" (UID: \"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec\") " pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:28.074570 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.074573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec-data\") pod \"postgres-69fb4594cf-mcsxz\" (UID: \"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec\") " pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:28.175626 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.175586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm78g\" (UniqueName: \"kubernetes.io/projected/729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec-kube-api-access-nm78g\") pod \"postgres-69fb4594cf-mcsxz\" (UID: \"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec\") " pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:28.175626 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.175624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec-data\") pod \"postgres-69fb4594cf-mcsxz\" (UID: \"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec\") " pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:28.176064 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.176043 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec-data\") pod \"postgres-69fb4594cf-mcsxz\" (UID: \"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec\") " pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:28.184263 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.184237 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm78g\" (UniqueName: \"kubernetes.io/projected/729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec-kube-api-access-nm78g\") pod \"postgres-69fb4594cf-mcsxz\" (UID: \"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec\") " pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:28.263672 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.263558 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:28.602517 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:28.602490 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mcsxz"] Jul 06 20:02:28.604896 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:02:28.604871 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod729ad934_98e2_4ac5_8f49_7b6fe9d7a9ec.slice/crio-a8c1129b95145a1d42399b1fa9479598d7228f77d8cd691e6fcf897008f66ded WatchSource:0}: Error finding container a8c1129b95145a1d42399b1fa9479598d7228f77d8cd691e6fcf897008f66ded: Status 404 returned error can't find the container with id a8c1129b95145a1d42399b1fa9479598d7228f77d8cd691e6fcf897008f66ded Jul 06 20:02:29.236260 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:29.236226 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mcsxz" event={"ID":"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec","Type":"ContainerStarted","Data":"a8c1129b95145a1d42399b1fa9479598d7228f77d8cd691e6fcf897008f66ded"} Jul 06 20:02:34.267758 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:34.267724 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mcsxz" event={"ID":"729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec","Type":"ContainerStarted","Data":"38359a0269245053a7e3889ff89090a2adb8433ab3cd8ee70afd13e0fc056a28"} Jul 06 20:02:34.268158 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:34.267834 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:34.293968 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:34.293912 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-mcsxz" podStartSLOduration=2.5805198750000002 podStartE2EDuration="7.293895611s" totalImagesPullingTime="4.713375736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:34.292373369 +0000 UTC m=+737.563127670" watchObservedRunningTime="2026-07-06 20:02:34.293895611 +0000 UTC m=+737.564649911" Jul 06 20:02:40.303181 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:40.303153 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-mcsxz" Jul 06 20:02:47.210675 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.210631 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f6c6bf99d-wnsz4"] Jul 06 20:02:47.229312 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.229283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:47.231499 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.231453 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f6c6bf99d-wnsz4"] Jul 06 20:02:47.231855 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.231831 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 20:02:47.231965 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.231840 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fqqt4\"" Jul 06 20:02:47.231965 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.231840 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 20:02:47.261588 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.261558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert\") pod \"maas-controller-f6c6bf99d-wnsz4\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:47.261763 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.261663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx2w7\" (UniqueName: \"kubernetes.io/projected/7523fb12-d370-42c8-941e-f908db18f867-kube-api-access-kx2w7\") pod \"maas-controller-f6c6bf99d-wnsz4\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:47.362978 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.362943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert\") pod \"maas-controller-f6c6bf99d-wnsz4\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:47.363182 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.363012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx2w7\" (UniqueName: \"kubernetes.io/projected/7523fb12-d370-42c8-941e-f908db18f867-kube-api-access-kx2w7\") pod \"maas-controller-f6c6bf99d-wnsz4\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:47.363182 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:02:47.363115 2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 06 20:02:47.363312 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:02:47.363206 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert podName:7523fb12-d370-42c8-941e-f908db18f867 nodeName:}" failed. No retries permitted until 2026-07-06 20:02:47.863175324 +0000 UTC m=+751.133929620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert") pod "maas-controller-f6c6bf99d-wnsz4" (UID: "7523fb12-d370-42c8-941e-f908db18f867") : secret "maas-controller-webhook-cert" not found Jul 06 20:02:47.374881 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.374853 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx2w7\" (UniqueName: \"kubernetes.io/projected/7523fb12-d370-42c8-941e-f908db18f867-kube-api-access-kx2w7\") pod \"maas-controller-f6c6bf99d-wnsz4\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:47.380222 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.380191 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-666975db4c-4trcq"] Jul 06 20:02:47.383955 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.383935 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.394471 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.394444 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666975db4c-4trcq"] Jul 06 20:02:47.464281 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.464197 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6bbff47-1710-494e-a898-50df35175ef0-webhook-cert\") pod \"maas-controller-666975db4c-4trcq\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.464281 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.464277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwd9z\" (UniqueName: \"kubernetes.io/projected/d6bbff47-1710-494e-a898-50df35175ef0-kube-api-access-gwd9z\") pod \"maas-controller-666975db4c-4trcq\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.564848 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.564810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6bbff47-1710-494e-a898-50df35175ef0-webhook-cert\") pod \"maas-controller-666975db4c-4trcq\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.565036 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.564878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwd9z\" (UniqueName: \"kubernetes.io/projected/d6bbff47-1710-494e-a898-50df35175ef0-kube-api-access-gwd9z\") pod \"maas-controller-666975db4c-4trcq\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.567272 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.567250 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6bbff47-1710-494e-a898-50df35175ef0-webhook-cert\") pod \"maas-controller-666975db4c-4trcq\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.572740 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.572715 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwd9z\" (UniqueName: \"kubernetes.io/projected/d6bbff47-1710-494e-a898-50df35175ef0-kube-api-access-gwd9z\") pod \"maas-controller-666975db4c-4trcq\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.695721 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.695685 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:47.830987 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.830962 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666975db4c-4trcq"] Jul 06 20:02:47.832912 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:02:47.832889 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6bbff47_1710_494e_a898_50df35175ef0.slice/crio-b24b62a878f260d15cf12765d5fca74824a7b0d93d0532e53cdbd0c9ad3ec776 WatchSource:0}: Error finding container b24b62a878f260d15cf12765d5fca74824a7b0d93d0532e53cdbd0c9ad3ec776: Status 404 returned error can't find the container with id b24b62a878f260d15cf12765d5fca74824a7b0d93d0532e53cdbd0c9ad3ec776 Jul 06 20:02:47.868515 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.868484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert\") pod \"maas-controller-f6c6bf99d-wnsz4\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:47.870821 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:47.870801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert\") pod \"maas-controller-f6c6bf99d-wnsz4\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:48.141250 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:48.141168 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:48.271487 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:48.271464 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f6c6bf99d-wnsz4"] Jul 06 20:02:48.273337 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:02:48.273310 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7523fb12_d370_42c8_941e_f908db18f867.slice/crio-e3d35dec9b92f4ada5c9101a6892abaeae92141adbd423325c48e99a39fe843b WatchSource:0}: Error finding container e3d35dec9b92f4ada5c9101a6892abaeae92141adbd423325c48e99a39fe843b: Status 404 returned error can't find the container with id e3d35dec9b92f4ada5c9101a6892abaeae92141adbd423325c48e99a39fe843b Jul 06 20:02:48.336184 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:48.336149 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" event={"ID":"7523fb12-d370-42c8-941e-f908db18f867","Type":"ContainerStarted","Data":"e3d35dec9b92f4ada5c9101a6892abaeae92141adbd423325c48e99a39fe843b"} Jul 06 20:02:48.337288 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:48.337262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666975db4c-4trcq" event={"ID":"d6bbff47-1710-494e-a898-50df35175ef0","Type":"ContainerStarted","Data":"b24b62a878f260d15cf12765d5fca74824a7b0d93d0532e53cdbd0c9ad3ec776"} Jul 06 20:02:51.360541 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:51.360494 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666975db4c-4trcq" event={"ID":"d6bbff47-1710-494e-a898-50df35175ef0","Type":"ContainerStarted","Data":"602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23"} Jul 06 20:02:51.361027 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:51.360897 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:02:51.362176 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:51.362153 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" event={"ID":"7523fb12-d370-42c8-941e-f908db18f867","Type":"ContainerStarted","Data":"0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7"} Jul 06 20:02:51.362342 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:51.362326 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:02:51.382157 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:51.382102 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-666975db4c-4trcq" podStartSLOduration=1.925263122 podStartE2EDuration="4.382085143s" totalImagesPullingTime="2.456822021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:51.380191906 +0000 UTC m=+754.650946207" watchObservedRunningTime="2026-07-06 20:02:51.382085143 +0000 UTC m=+754.652839444" Jul 06 20:02:51.399408 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:02:51.399366 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" podStartSLOduration=2.372134848 podStartE2EDuration="4.39935332s" totalImagesPullingTime="2.027218472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:02:51.397983676 +0000 UTC m=+754.668737976" watchObservedRunningTime="2026-07-06 20:02:51.39935332 +0000 UTC m=+754.670107621" Jul 06 20:03:02.372982 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.372951 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:03:02.373461 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.373400 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:03:02.418103 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.418048 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f6c6bf99d-wnsz4"] Jul 06 20:03:02.419796 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.419745 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" podUID="7523fb12-d370-42c8-941e-f908db18f867" containerName="manager" containerID="cri-o://0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7" gracePeriod=30 Jul 06 20:03:02.667490 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.667464 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:03:02.716445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.716414 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kx2w7\" (UniqueName: \"kubernetes.io/projected/7523fb12-d370-42c8-941e-f908db18f867-kube-api-access-kx2w7\") pod \"7523fb12-d370-42c8-941e-f908db18f867\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " Jul 06 20:03:02.716609 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.716507 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert\") pod \"7523fb12-d370-42c8-941e-f908db18f867\" (UID: \"7523fb12-d370-42c8-941e-f908db18f867\") " Jul 06 20:03:02.718585 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.718554 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7523fb12-d370-42c8-941e-f908db18f867" (UID: "7523fb12-d370-42c8-941e-f908db18f867"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:03:02.718726 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.718598 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7523fb12-d370-42c8-941e-f908db18f867-kube-api-access-kx2w7" (OuterVolumeSpecName: "kube-api-access-kx2w7") pod "7523fb12-d370-42c8-941e-f908db18f867" (UID: "7523fb12-d370-42c8-941e-f908db18f867"). InnerVolumeSpecName "kube-api-access-kx2w7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:03:02.817771 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.817739 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kx2w7\" (UniqueName: \"kubernetes.io/projected/7523fb12-d370-42c8-941e-f908db18f867-kube-api-access-kx2w7\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:03:02.817771 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:02.817766 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7523fb12-d370-42c8-941e-f908db18f867-webhook-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:03:03.426201 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.426165 2558 generic.go:356] "Generic (PLEG): container finished" podID="7523fb12-d370-42c8-941e-f908db18f867" containerID="0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7" exitCode=0 Jul 06 20:03:03.426201 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.426207 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" Jul 06 20:03:03.426759 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.426244 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" event={"ID":"7523fb12-d370-42c8-941e-f908db18f867","Type":"ContainerDied","Data":"0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7"} Jul 06 20:03:03.426759 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.426299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6c6bf99d-wnsz4" event={"ID":"7523fb12-d370-42c8-941e-f908db18f867","Type":"ContainerDied","Data":"e3d35dec9b92f4ada5c9101a6892abaeae92141adbd423325c48e99a39fe843b"} Jul 06 20:03:03.426759 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.426322 2558 scope.go:117] "RemoveContainer" containerID="0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7" Jul 06 20:03:03.435023 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.435008 2558 scope.go:117] "RemoveContainer" containerID="0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7" Jul 06 20:03:03.435282 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:03:03.435264 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7\": container with ID starting with 0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7 not found: ID does not exist" containerID="0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7" Jul 06 20:03:03.435331 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.435292 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7"} err="failed to get container status \"0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7\": rpc error: code = NotFound desc = could not find container \"0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7\": container with ID starting with 0699113899fd5e26a14c0e030f8ab6dc71c3381f18cd8651849fa2ccadd830e7 not found: ID does not exist" Jul 06 20:03:03.443949 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.443921 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f6c6bf99d-wnsz4"] Jul 06 20:03:03.447987 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:03.447951 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f6c6bf99d-wnsz4"] Jul 06 20:03:05.321248 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:05.321215 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7523fb12-d370-42c8-941e-f908db18f867" path="/var/lib/kubelet/pods/7523fb12-d370-42c8-941e-f908db18f867/volumes" Jul 06 20:03:22.403256 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.403210 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-69c479884b-bdm5q"] Jul 06 20:03:22.403814 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.403796 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7523fb12-d370-42c8-941e-f908db18f867" containerName="manager" Jul 06 20:03:22.403891 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.403816 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7523fb12-d370-42c8-941e-f908db18f867" containerName="manager" Jul 06 20:03:22.403972 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.403960 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7523fb12-d370-42c8-941e-f908db18f867" containerName="manager" Jul 06 20:03:22.409039 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.409014 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.412752 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.412724 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 06 20:03:22.412874 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.412776 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-mthr8\"" Jul 06 20:03:22.424893 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.424863 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69c479884b-bdm5q"] Jul 06 20:03:22.499837 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.499799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4qj7\" (UniqueName: \"kubernetes.io/projected/9cb18cc1-c473-4810-96aa-59d4a3690a62-kube-api-access-g4qj7\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.500010 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.499870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb18cc1-c473-4810-96aa-59d4a3690a62-openshift-service-ca\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.500010 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.499906 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cb18cc1-c473-4810-96aa-59d4a3690a62-maas-api-tls\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.601299 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.601256 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb18cc1-c473-4810-96aa-59d4a3690a62-openshift-service-ca\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.601299 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.601301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cb18cc1-c473-4810-96aa-59d4a3690a62-maas-api-tls\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.601568 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.601370 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4qj7\" (UniqueName: \"kubernetes.io/projected/9cb18cc1-c473-4810-96aa-59d4a3690a62-kube-api-access-g4qj7\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.601568 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:03:22.601492 2558 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 06 20:03:22.601688 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:03:22.601572 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cb18cc1-c473-4810-96aa-59d4a3690a62-maas-api-tls podName:9cb18cc1-c473-4810-96aa-59d4a3690a62 nodeName:}" failed. No retries permitted until 2026-07-06 20:03:23.101552166 +0000 UTC m=+786.372306467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9cb18cc1-c473-4810-96aa-59d4a3690a62-maas-api-tls") pod "maas-api-69c479884b-bdm5q" (UID: "9cb18cc1-c473-4810-96aa-59d4a3690a62") : secret "maas-api-serving-cert" not found Jul 06 20:03:22.602100 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.602077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cb18cc1-c473-4810-96aa-59d4a3690a62-openshift-service-ca\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:22.612487 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:22.612459 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4qj7\" (UniqueName: \"kubernetes.io/projected/9cb18cc1-c473-4810-96aa-59d4a3690a62-kube-api-access-g4qj7\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:23.035109 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.035061 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-xbhhg"] Jul 06 20:03:23.040299 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.040263 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.042862 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.042840 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-mhhmp\"" Jul 06 20:03:23.043013 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.042886 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 06 20:03:23.047227 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.047200 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-xbhhg"] Jul 06 20:03:23.108048 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.108012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cb18cc1-c473-4810-96aa-59d4a3690a62-maas-api-tls\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:23.108238 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.108186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gkpv\" (UniqueName: \"kubernetes.io/projected/40191def-f8c8-4bc3-b005-b666b02c837f-kube-api-access-9gkpv\") pod \"payload-processing-58f86c7798-xbhhg\" (UID: \"40191def-f8c8-4bc3-b005-b666b02c837f\") " pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.108238 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.108222 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40191def-f8c8-4bc3-b005-b666b02c837f-plugins-config-volume\") pod \"payload-processing-58f86c7798-xbhhg\" (UID: \"40191def-f8c8-4bc3-b005-b666b02c837f\") " pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.111140 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.111109 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cb18cc1-c473-4810-96aa-59d4a3690a62-maas-api-tls\") pod \"maas-api-69c479884b-bdm5q\" (UID: \"9cb18cc1-c473-4810-96aa-59d4a3690a62\") " pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:23.208811 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.208777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gkpv\" (UniqueName: \"kubernetes.io/projected/40191def-f8c8-4bc3-b005-b666b02c837f-kube-api-access-9gkpv\") pod \"payload-processing-58f86c7798-xbhhg\" (UID: \"40191def-f8c8-4bc3-b005-b666b02c837f\") " pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.208811 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.208815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40191def-f8c8-4bc3-b005-b666b02c837f-plugins-config-volume\") pod \"payload-processing-58f86c7798-xbhhg\" (UID: \"40191def-f8c8-4bc3-b005-b666b02c837f\") " pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.209485 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.209467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40191def-f8c8-4bc3-b005-b666b02c837f-plugins-config-volume\") pod \"payload-processing-58f86c7798-xbhhg\" (UID: \"40191def-f8c8-4bc3-b005-b666b02c837f\") " pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.224371 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.224337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gkpv\" (UniqueName: \"kubernetes.io/projected/40191def-f8c8-4bc3-b005-b666b02c837f-kube-api-access-9gkpv\") pod \"payload-processing-58f86c7798-xbhhg\" (UID: \"40191def-f8c8-4bc3-b005-b666b02c837f\") " pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.319697 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.319592 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:23.352795 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.352758 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:23.481020 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.480978 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69c479884b-bdm5q"] Jul 06 20:03:23.482230 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:03:23.482195 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cb18cc1_c473_4810_96aa_59d4a3690a62.slice/crio-841276da983c29d2ea2eaedadde566bcf9ee042ed26bb865c55f11338cb3e119 WatchSource:0}: Error finding container 841276da983c29d2ea2eaedadde566bcf9ee042ed26bb865c55f11338cb3e119: Status 404 returned error can't find the container with id 841276da983c29d2ea2eaedadde566bcf9ee042ed26bb865c55f11338cb3e119 Jul 06 20:03:23.515377 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.515341 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-xbhhg"] Jul 06 20:03:23.520432 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:03:23.520405 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40191def_f8c8_4bc3_b005_b666b02c837f.slice/crio-8e8baaa2d2eb3dc8f740b6e65964e00979a22f5742a0272e4ff6ea50b54564dd WatchSource:0}: Error finding container 8e8baaa2d2eb3dc8f740b6e65964e00979a22f5742a0272e4ff6ea50b54564dd: Status 404 returned error can't find the container with id 8e8baaa2d2eb3dc8f740b6e65964e00979a22f5742a0272e4ff6ea50b54564dd Jul 06 20:03:23.532557 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.532526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" event={"ID":"40191def-f8c8-4bc3-b005-b666b02c837f","Type":"ContainerStarted","Data":"8e8baaa2d2eb3dc8f740b6e65964e00979a22f5742a0272e4ff6ea50b54564dd"} Jul 06 20:03:23.533819 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:23.533784 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69c479884b-bdm5q" event={"ID":"9cb18cc1-c473-4810-96aa-59d4a3690a62","Type":"ContainerStarted","Data":"841276da983c29d2ea2eaedadde566bcf9ee042ed26bb865c55f11338cb3e119"} Jul 06 20:03:26.555564 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:26.555528 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" event={"ID":"40191def-f8c8-4bc3-b005-b666b02c837f","Type":"ContainerStarted","Data":"92dd89217baffc5ddb4f46c5cd7651669492298cdd1a4844e9c524b09c5b1e0e"} Jul 06 20:03:26.556075 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:26.555595 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:26.557117 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:26.557089 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69c479884b-bdm5q" event={"ID":"9cb18cc1-c473-4810-96aa-59d4a3690a62","Type":"ContainerStarted","Data":"752ac8cd60c9985032bf8024ee1b22b4d5ad1379ec4a97f5db34b53656a879e3"} Jul 06 20:03:26.557234 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:26.557135 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:26.575677 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:26.575583 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" podStartSLOduration=1.439224133 podStartE2EDuration="3.575560184s" totalImagesPullingTime="2.136336051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:26.572975854 +0000 UTC m=+789.843730156" watchObservedRunningTime="2026-07-06 20:03:26.575560184 +0000 UTC m=+789.846314482" Jul 06 20:03:26.592651 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:26.592586 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-69c479884b-bdm5q" podStartSLOduration=2.418680072 podStartE2EDuration="4.592566127s" totalImagesPullingTime="2.173886055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:26.591164985 +0000 UTC m=+789.861919286" watchObservedRunningTime="2026-07-06 20:03:26.592566127 +0000 UTC m=+789.863320436" Jul 06 20:03:31.585892 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:31.585859 2558 generic.go:356] "Generic (PLEG): container finished" podID="67011710-a339-4f0d-949b-eb210557c3d1" containerID="af4c5a092dc62f8b1eae02108903e096bd46ff9c6e9705dc57e9cdec662acf56" exitCode=0 Jul 06 20:03:31.586331 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:31.585932 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" event={"ID":"67011710-a339-4f0d-949b-eb210557c3d1","Type":"ContainerDied","Data":"af4c5a092dc62f8b1eae02108903e096bd46ff9c6e9705dc57e9cdec662acf56"} Jul 06 20:03:31.586384 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:31.586371 2558 scope.go:117] "RemoveContainer" containerID="af4c5a092dc62f8b1eae02108903e096bd46ff9c6e9705dc57e9cdec662acf56" Jul 06 20:03:31.587376 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:31.587347 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:03:31.587452 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:31.587418 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:03:31.587488 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:31.587466 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:03:32.572752 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:32.572716 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-69c479884b-bdm5q" Jul 06 20:03:32.594256 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:32.594225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" event={"ID":"67011710-a339-4f0d-949b-eb210557c3d1","Type":"ContainerStarted","Data":"86c93599b99ce7b06b218074ea0be2ca3fcc529b9c8272a71b02cb540c7b1006"} Jul 06 20:03:33.358858 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:33.358813 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:03:33.372840 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:33.372798 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bznwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:03:33.373127 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:33.373095 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" podUID="67011710-a339-4f0d-949b-eb210557c3d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 20:03:34.359512 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:34.359475 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bznwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:03:34.360040 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:34.359535 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" podUID="67011710-a339-4f0d-949b-eb210557c3d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 20:03:35.359432 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:35.359399 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bznwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:03:35.359615 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:35.359456 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" podUID="67011710-a339-4f0d-949b-eb210557c3d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 20:03:36.030995 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:36.030954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:03:36.359871 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:36.359769 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-bznwm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 06 20:03:36.359871 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:36.359847 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" podUID="67011710-a339-4f0d-949b-eb210557c3d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 06 20:03:37.363563 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:37.363533 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:03:37.364504 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:37.364487 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-bznwm" Jul 06 20:03:37.566511 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:37.566481 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-xbhhg" Jul 06 20:03:42.558221 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.558139 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9"] Jul 06 20:03:42.560799 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.560781 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.563783 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.563745 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 20:03:42.563783 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.563774 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 20:03:42.563972 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.563899 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 20:03:42.564812 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.564791 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-75vhw\"" Jul 06 20:03:42.572710 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.572650 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9"] Jul 06 20:03:42.697099 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.697058 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7722616-5e0f-4878-a107-bae3de41c0a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.697282 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.697107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fr4f\" (UniqueName: \"kubernetes.io/projected/c7722616-5e0f-4878-a107-bae3de41c0a1-kube-api-access-6fr4f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.697282 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.697130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.697282 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.697209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.697282 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.697234 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.697428 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.697307 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.798695 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.798615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7722616-5e0f-4878-a107-bae3de41c0a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.798877 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.798713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fr4f\" (UniqueName: \"kubernetes.io/projected/c7722616-5e0f-4878-a107-bae3de41c0a1-kube-api-access-6fr4f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.798877 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.798745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.798877 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.798807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.798877 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.798839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.799052 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.798902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.799248 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.799209 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.799248 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.799230 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.799422 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.799312 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.801033 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.801014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7722616-5e0f-4878-a107-bae3de41c0a1-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.801428 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.801408 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7722616-5e0f-4878-a107-bae3de41c0a1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.806776 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.806753 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fr4f\" (UniqueName: \"kubernetes.io/projected/c7722616-5e0f-4878-a107-bae3de41c0a1-kube-api-access-6fr4f\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9\" (UID: \"c7722616-5e0f-4878-a107-bae3de41c0a1\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:42.873563 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:42.873455 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:43.014528 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:43.014503 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9"] Jul 06 20:03:43.016184 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:03:43.016150 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7722616_5e0f_4878_a107_bae3de41c0a1.slice/crio-60d1260454bd8b2bf5ad0893b52e8bf216a50099c0791c5a05cbb5512ff18674 WatchSource:0}: Error finding container 60d1260454bd8b2bf5ad0893b52e8bf216a50099c0791c5a05cbb5512ff18674: Status 404 returned error can't find the container with id 60d1260454bd8b2bf5ad0893b52e8bf216a50099c0791c5a05cbb5512ff18674 Jul 06 20:03:43.654506 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:43.654468 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" event={"ID":"c7722616-5e0f-4878-a107-bae3de41c0a1","Type":"ContainerStarted","Data":"60d1260454bd8b2bf5ad0893b52e8bf216a50099c0791c5a05cbb5512ff18674"} Jul 06 20:03:44.660982 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:44.660943 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" event={"ID":"c7722616-5e0f-4878-a107-bae3de41c0a1","Type":"ContainerStarted","Data":"8a01e49f009886f98061bd2f94c62d532342b437b0e34a63216b4c11b4019462"} Jul 06 20:03:44.681480 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:44.681430 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" podStartSLOduration=1.667292577 podStartE2EDuration="2.681413848s" totalImagesPullingTime="1.014121271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:03:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:44.679501288 +0000 UTC m=+807.950255613" watchObservedRunningTime="2026-07-06 20:03:44.681413848 +0000 UTC m=+807.952168149" Jul 06 20:03:52.873998 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:52.873958 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:52.874539 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:52.874024 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:52.887821 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:52.887795 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:03:53.720810 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:03:53.720780 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9" Jul 06 20:04:05.062772 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.062735 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8"] Jul 06 20:04:05.067986 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.067964 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.070464 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.070440 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 06 20:04:05.076489 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.076463 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8"] Jul 06 20:04:05.125183 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.125146 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.125371 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.125200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.125371 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.125316 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.125454 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.125370 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a68809b6-ba30-4920-93d5-2b2952c016b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.125454 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.125414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxczv\" (UniqueName: \"kubernetes.io/projected/a68809b6-ba30-4920-93d5-2b2952c016b8-kube-api-access-jxczv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.125533 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.125453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.226559 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.226528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.226768 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.226578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.226768 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.226600 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.226768 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.226625 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a68809b6-ba30-4920-93d5-2b2952c016b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.226768 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.226679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxczv\" (UniqueName: \"kubernetes.io/projected/a68809b6-ba30-4920-93d5-2b2952c016b8-kube-api-access-jxczv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.226768 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.226729 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.227147 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.227121 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.227220 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.227178 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.227275 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.227217 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.228821 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.228802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a68809b6-ba30-4920-93d5-2b2952c016b8-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.229228 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.229211 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a68809b6-ba30-4920-93d5-2b2952c016b8-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.235589 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.235561 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxczv\" (UniqueName: \"kubernetes.io/projected/a68809b6-ba30-4920-93d5-2b2952c016b8-kube-api-access-jxczv\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5fbs8\" (UID: \"a68809b6-ba30-4920-93d5-2b2952c016b8\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.379871 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.379776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:05.531115 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.531088 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8"] Jul 06 20:04:05.533979 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:04:05.533945 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda68809b6_ba30_4920_93d5_2b2952c016b8.slice/crio-befcfced01d2c99dcf6fbc4ce66638066570d1564f3f3fee74529551c0dd8d4c WatchSource:0}: Error finding container befcfced01d2c99dcf6fbc4ce66638066570d1564f3f3fee74529551c0dd8d4c: Status 404 returned error can't find the container with id befcfced01d2c99dcf6fbc4ce66638066570d1564f3f3fee74529551c0dd8d4c Jul 06 20:04:05.771261 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:05.771224 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" event={"ID":"a68809b6-ba30-4920-93d5-2b2952c016b8","Type":"ContainerStarted","Data":"befcfced01d2c99dcf6fbc4ce66638066570d1564f3f3fee74529551c0dd8d4c"} Jul 06 20:04:06.777973 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:06.777938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" event={"ID":"a68809b6-ba30-4920-93d5-2b2952c016b8","Type":"ContainerStarted","Data":"8c7cf33f774c955db04904118d2111a6b669e02ab3ba5fd07332dc34237c682f"} Jul 06 20:04:06.795520 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:06.795468 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" podStartSLOduration=1.5716886890000001 podStartE2EDuration="1.795449333s" totalImagesPullingTime="223.760644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:04:06.795450297 +0000 UTC m=+830.066204599" watchObservedRunningTime="2026-07-06 20:04:06.795449333 +0000 UTC m=+830.066203638" Jul 06 20:04:15.380898 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:15.380862 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:15.381297 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:15.380937 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:15.393736 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:15.393714 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:04:15.837630 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:04:15.837603 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5fbs8" Jul 06 20:05:17.178608 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:05:17.178527 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:05:17.180336 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:05:17.180312 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:07:07.719066 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:07.719034 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666975db4c-4trcq"] Jul 06 20:07:07.719654 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:07.719213 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-666975db4c-4trcq" podUID="d6bbff47-1710-494e-a898-50df35175ef0" containerName="manager" containerID="cri-o://602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23" gracePeriod=30 Jul 06 20:07:07.973307 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:07.973244 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:07:08.101996 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.101963 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6bbff47-1710-494e-a898-50df35175ef0-webhook-cert\") pod \"d6bbff47-1710-494e-a898-50df35175ef0\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " Jul 06 20:07:08.102169 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.102032 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwd9z\" (UniqueName: \"kubernetes.io/projected/d6bbff47-1710-494e-a898-50df35175ef0-kube-api-access-gwd9z\") pod \"d6bbff47-1710-494e-a898-50df35175ef0\" (UID: \"d6bbff47-1710-494e-a898-50df35175ef0\") " Jul 06 20:07:08.104047 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.104019 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6bbff47-1710-494e-a898-50df35175ef0-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d6bbff47-1710-494e-a898-50df35175ef0" (UID: "d6bbff47-1710-494e-a898-50df35175ef0"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:07:08.104176 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.104149 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6bbff47-1710-494e-a898-50df35175ef0-kube-api-access-gwd9z" (OuterVolumeSpecName: "kube-api-access-gwd9z") pod "d6bbff47-1710-494e-a898-50df35175ef0" (UID: "d6bbff47-1710-494e-a898-50df35175ef0"). InnerVolumeSpecName "kube-api-access-gwd9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:07:08.203525 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.203485 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6bbff47-1710-494e-a898-50df35175ef0-webhook-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:07:08.203525 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.203516 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwd9z\" (UniqueName: \"kubernetes.io/projected/d6bbff47-1710-494e-a898-50df35175ef0-kube-api-access-gwd9z\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:07:08.746573 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.746536 2558 generic.go:356] "Generic (PLEG): container finished" podID="d6bbff47-1710-494e-a898-50df35175ef0" containerID="602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23" exitCode=0 Jul 06 20:07:08.747052 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.746592 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666975db4c-4trcq" Jul 06 20:07:08.747052 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.746614 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666975db4c-4trcq" event={"ID":"d6bbff47-1710-494e-a898-50df35175ef0","Type":"ContainerDied","Data":"602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23"} Jul 06 20:07:08.747052 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.746713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666975db4c-4trcq" event={"ID":"d6bbff47-1710-494e-a898-50df35175ef0","Type":"ContainerDied","Data":"b24b62a878f260d15cf12765d5fca74824a7b0d93d0532e53cdbd0c9ad3ec776"} Jul 06 20:07:08.747052 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.746730 2558 scope.go:117] "RemoveContainer" containerID="602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23" Jul 06 20:07:08.756447 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.756432 2558 scope.go:117] "RemoveContainer" containerID="602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23" Jul 06 20:07:08.756738 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:07:08.756720 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23\": container with ID starting with 602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23 not found: ID does not exist" containerID="602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23" Jul 06 20:07:08.756785 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.756746 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23"} err="failed to get container status \"602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23\": rpc error: code = NotFound desc = could not find container \"602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23\": container with ID starting with 602ae853fdce7e6b3637cdeba39a63a4c7308facac2e1ecd8c36005467252a23 not found: ID does not exist" Jul 06 20:07:08.769274 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.769252 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-666975db4c-4trcq"] Jul 06 20:07:08.773166 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:08.773144 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-666975db4c-4trcq"] Jul 06 20:07:09.321684 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.321650 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6bbff47-1710-494e-a898-50df35175ef0" path="/var/lib/kubelet/pods/d6bbff47-1710-494e-a898-50df35175ef0/volumes" Jul 06 20:07:09.544652 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.544616 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-666975db4c-d8gz2"] Jul 06 20:07:09.545039 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.545025 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6bbff47-1710-494e-a898-50df35175ef0" containerName="manager" Jul 06 20:07:09.545091 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.545041 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6bbff47-1710-494e-a898-50df35175ef0" containerName="manager" Jul 06 20:07:09.545212 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.545200 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6bbff47-1710-494e-a898-50df35175ef0" containerName="manager" Jul 06 20:07:09.549650 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.549618 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:09.553119 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.553101 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 06 20:07:09.553216 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.553119 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fqqt4\"" Jul 06 20:07:09.553216 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.553166 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 06 20:07:09.558154 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.558132 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666975db4c-d8gz2"] Jul 06 20:07:09.719277 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.719242 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqtzm\" (UniqueName: \"kubernetes.io/projected/7d66c9a2-f9aa-43d2-8634-f136d382db90-kube-api-access-fqtzm\") pod \"maas-controller-666975db4c-d8gz2\" (UID: \"7d66c9a2-f9aa-43d2-8634-f136d382db90\") " pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:09.719459 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.719298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d66c9a2-f9aa-43d2-8634-f136d382db90-webhook-cert\") pod \"maas-controller-666975db4c-d8gz2\" (UID: \"7d66c9a2-f9aa-43d2-8634-f136d382db90\") " pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:09.819930 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.819897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqtzm\" (UniqueName: \"kubernetes.io/projected/7d66c9a2-f9aa-43d2-8634-f136d382db90-kube-api-access-fqtzm\") pod \"maas-controller-666975db4c-d8gz2\" (UID: \"7d66c9a2-f9aa-43d2-8634-f136d382db90\") " pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:09.820335 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.819940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d66c9a2-f9aa-43d2-8634-f136d382db90-webhook-cert\") pod \"maas-controller-666975db4c-d8gz2\" (UID: \"7d66c9a2-f9aa-43d2-8634-f136d382db90\") " pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:09.822446 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.822422 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7d66c9a2-f9aa-43d2-8634-f136d382db90-webhook-cert\") pod \"maas-controller-666975db4c-d8gz2\" (UID: \"7d66c9a2-f9aa-43d2-8634-f136d382db90\") " pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:09.827998 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.827980 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqtzm\" (UniqueName: \"kubernetes.io/projected/7d66c9a2-f9aa-43d2-8634-f136d382db90-kube-api-access-fqtzm\") pod \"maas-controller-666975db4c-d8gz2\" (UID: \"7d66c9a2-f9aa-43d2-8634-f136d382db90\") " pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:09.860974 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:09.860941 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:10.002223 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:10.002195 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-666975db4c-d8gz2"] Jul 06 20:07:10.003496 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:07:10.003472 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d66c9a2_f9aa_43d2_8634_f136d382db90.slice/crio-e611cdbcd7b58e1dd3ccaf31406be967bef590c98b2fab86a1941baadbfada7f WatchSource:0}: Error finding container e611cdbcd7b58e1dd3ccaf31406be967bef590c98b2fab86a1941baadbfada7f: Status 404 returned error can't find the container with id e611cdbcd7b58e1dd3ccaf31406be967bef590c98b2fab86a1941baadbfada7f Jul 06 20:07:10.004987 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:10.004966 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:07:10.759921 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:10.759900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666975db4c-d8gz2" event={"ID":"7d66c9a2-f9aa-43d2-8634-f136d382db90","Type":"ContainerStarted","Data":"e611cdbcd7b58e1dd3ccaf31406be967bef590c98b2fab86a1941baadbfada7f"} Jul 06 20:07:11.766621 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:11.766577 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-666975db4c-d8gz2" event={"ID":"7d66c9a2-f9aa-43d2-8634-f136d382db90","Type":"ContainerStarted","Data":"6e3b3e80283260bc9bdafe258db5440152b498c4d274a7408a39857b696f40cd"} Jul 06 20:07:11.767045 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:11.766713 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:07:11.792357 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:11.792306 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-666975db4c-d8gz2" podStartSLOduration=2.041996839 podStartE2EDuration="2.792291769s" totalImagesPullingTime="750.29493ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:07:11.790451828 +0000 UTC m=+1015.061206129" watchObservedRunningTime="2026-07-06 20:07:11.792291769 +0000 UTC m=+1015.063046070" Jul 06 20:07:22.778328 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:07:22.778297 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-666975db4c-d8gz2" Jul 06 20:10:17.210306 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:17.210274 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:10:17.212973 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:17.212951 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:10:58.248445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.248409 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8767cd97f-rmdtg"] Jul 06 20:10:58.253130 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.253106 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.278632 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.278600 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8767cd97f-rmdtg"] Jul 06 20:10:58.339862 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.339809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-config\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.340050 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.339879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpk52\" (UniqueName: \"kubernetes.io/projected/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-kube-api-access-wpk52\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.340050 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.339932 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-service-ca\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.340050 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.340030 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-oauth-config\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.340196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.340061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-trusted-ca-bundle\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.340196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.340086 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-serving-cert\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.340196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.340150 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-oauth-serving-cert\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.440987 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.440946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpk52\" (UniqueName: \"kubernetes.io/projected/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-kube-api-access-wpk52\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.441196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-service-ca\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.441196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441089 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-oauth-config\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.441196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-trusted-ca-bundle\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.441196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-serving-cert\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.441196 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-oauth-serving-cert\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.441475 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-config\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.441999 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441974 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-config\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.442118 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.441985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-service-ca\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.442274 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.442251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-oauth-serving-cert\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.442315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.442251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-trusted-ca-bundle\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.443690 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.443668 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-serving-cert\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.443776 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.443707 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-console-oauth-config\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.448985 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.448965 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpk52\" (UniqueName: \"kubernetes.io/projected/0791277d-0f2d-49d9-a4c2-3be0c42a18e8-kube-api-access-wpk52\") pod \"console-8767cd97f-rmdtg\" (UID: \"0791277d-0f2d-49d9-a4c2-3be0c42a18e8\") " pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.563357 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.563254 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:10:58.717044 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.717016 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8767cd97f-rmdtg"] Jul 06 20:10:58.718896 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:10:58.718870 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0791277d_0f2d_49d9_a4c2_3be0c42a18e8.slice/crio-a341ac06e6b2edba832074e55db2e21239a44b3ae06e1405f53d8f1bb9343a29 WatchSource:0}: Error finding container a341ac06e6b2edba832074e55db2e21239a44b3ae06e1405f53d8f1bb9343a29: Status 404 returned error can't find the container with id a341ac06e6b2edba832074e55db2e21239a44b3ae06e1405f53d8f1bb9343a29 Jul 06 20:10:58.987247 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.987210 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8767cd97f-rmdtg" event={"ID":"0791277d-0f2d-49d9-a4c2-3be0c42a18e8","Type":"ContainerStarted","Data":"7b21b6e17108eb101a3d3eb51eb01bfe32bd41792005941a3c93f5d465d30233"} Jul 06 20:10:58.987427 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:58.987266 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8767cd97f-rmdtg" event={"ID":"0791277d-0f2d-49d9-a4c2-3be0c42a18e8","Type":"ContainerStarted","Data":"a341ac06e6b2edba832074e55db2e21239a44b3ae06e1405f53d8f1bb9343a29"} Jul 06 20:10:59.007233 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:10:59.007174 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8767cd97f-rmdtg" podStartSLOduration=1.007154493 podStartE2EDuration="1.007154493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:10:59.005451725 +0000 UTC m=+1242.276206026" watchObservedRunningTime="2026-07-06 20:10:59.007154493 +0000 UTC m=+1242.277908794" Jul 06 20:11:08.563626 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:08.563529 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:11:08.563626 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:08.563589 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:11:08.568495 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:08.568471 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:11:09.045582 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:09.045508 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8767cd97f-rmdtg" Jul 06 20:11:09.100984 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:09.100947 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584c6c56d7-ffgtm"] Jul 06 20:11:34.130530 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.130463 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-584c6c56d7-ffgtm" podUID="70df8642-31f3-4891-a50a-9321926651f1" containerName="console" containerID="cri-o://f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db" gracePeriod=15 Jul 06 20:11:34.388185 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.388125 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 20:11:34.483829 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.483790 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-service-ca\") pod \"70df8642-31f3-4891-a50a-9321926651f1\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " Jul 06 20:11:34.484003 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.483875 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-oauth-config\") pod \"70df8642-31f3-4891-a50a-9321926651f1\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " Jul 06 20:11:34.484003 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.483898 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-trusted-ca-bundle\") pod \"70df8642-31f3-4891-a50a-9321926651f1\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " Jul 06 20:11:34.484003 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.483933 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-oauth-serving-cert\") pod \"70df8642-31f3-4891-a50a-9321926651f1\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " Jul 06 20:11:34.484003 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.483954 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-serving-cert\") pod \"70df8642-31f3-4891-a50a-9321926651f1\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " Jul 06 20:11:34.484003 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.483994 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scgj4\" (UniqueName: \"kubernetes.io/projected/70df8642-31f3-4891-a50a-9321926651f1-kube-api-access-scgj4\") pod \"70df8642-31f3-4891-a50a-9321926651f1\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " Jul 06 20:11:34.484272 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.484070 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-console-config\") pod \"70df8642-31f3-4891-a50a-9321926651f1\" (UID: \"70df8642-31f3-4891-a50a-9321926651f1\") " Jul 06 20:11:34.484330 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.484272 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-service-ca" (OuterVolumeSpecName: "service-ca") pod "70df8642-31f3-4891-a50a-9321926651f1" (UID: "70df8642-31f3-4891-a50a-9321926651f1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:11:34.484479 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.484458 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-service-ca\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:11:34.484560 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.484501 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "70df8642-31f3-4891-a50a-9321926651f1" (UID: "70df8642-31f3-4891-a50a-9321926651f1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:11:34.484560 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.484518 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "70df8642-31f3-4891-a50a-9321926651f1" (UID: "70df8642-31f3-4891-a50a-9321926651f1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:11:34.484700 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.484575 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-console-config" (OuterVolumeSpecName: "console-config") pod "70df8642-31f3-4891-a50a-9321926651f1" (UID: "70df8642-31f3-4891-a50a-9321926651f1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:11:34.486164 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.486134 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "70df8642-31f3-4891-a50a-9321926651f1" (UID: "70df8642-31f3-4891-a50a-9321926651f1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:11:34.486252 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.486159 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "70df8642-31f3-4891-a50a-9321926651f1" (UID: "70df8642-31f3-4891-a50a-9321926651f1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:11:34.486252 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.486195 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70df8642-31f3-4891-a50a-9321926651f1-kube-api-access-scgj4" (OuterVolumeSpecName: "kube-api-access-scgj4") pod "70df8642-31f3-4891-a50a-9321926651f1" (UID: "70df8642-31f3-4891-a50a-9321926651f1"). InnerVolumeSpecName "kube-api-access-scgj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:11:34.585184 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.585145 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scgj4\" (UniqueName: \"kubernetes.io/projected/70df8642-31f3-4891-a50a-9321926651f1-kube-api-access-scgj4\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:11:34.585184 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.585180 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-console-config\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:11:34.585184 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.585190 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-oauth-config\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:11:34.585464 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.585199 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-trusted-ca-bundle\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:11:34.585464 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.585209 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/70df8642-31f3-4891-a50a-9321926651f1-oauth-serving-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:11:34.585464 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:34.585219 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/70df8642-31f3-4891-a50a-9321926651f1-console-serving-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:11:35.179589 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.179554 2558 generic.go:356] "Generic (PLEG): container finished" podID="70df8642-31f3-4891-a50a-9321926651f1" containerID="f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db" exitCode=0 Jul 06 20:11:35.180109 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.179599 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-584c6c56d7-ffgtm" Jul 06 20:11:35.180109 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.179663 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584c6c56d7-ffgtm" event={"ID":"70df8642-31f3-4891-a50a-9321926651f1","Type":"ContainerDied","Data":"f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db"} Jul 06 20:11:35.180109 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.179721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-584c6c56d7-ffgtm" event={"ID":"70df8642-31f3-4891-a50a-9321926651f1","Type":"ContainerDied","Data":"69c502ad9938493e4fc9ff60e736940a51c3432267108fc5cb646c5e4d45da0f"} Jul 06 20:11:35.180109 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.179749 2558 scope.go:117] "RemoveContainer" containerID="f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db" Jul 06 20:11:35.189481 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.189462 2558 scope.go:117] "RemoveContainer" containerID="f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db" Jul 06 20:11:35.189749 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:11:35.189730 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db\": container with ID starting with f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db not found: ID does not exist" containerID="f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db" Jul 06 20:11:35.189829 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.189757 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db"} err="failed to get container status \"f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db\": rpc error: code = NotFound desc = could not find container \"f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db\": container with ID starting with f80cb1285c812ee30bc04c3e2fba6212ba905c017a55d7cb4f9730c41136a5db not found: ID does not exist" Jul 06 20:11:35.201602 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.201580 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-584c6c56d7-ffgtm"] Jul 06 20:11:35.205555 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.205534 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-584c6c56d7-ffgtm"] Jul 06 20:11:35.321242 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:11:35.321209 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70df8642-31f3-4891-a50a-9321926651f1" path="/var/lib/kubelet/pods/70df8642-31f3-4891-a50a-9321926651f1/volumes" Jul 06 20:15:00.139133 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.139097 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722815-prbrb"] Jul 06 20:15:00.139630 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.139532 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70df8642-31f3-4891-a50a-9321926651f1" containerName="console" Jul 06 20:15:00.139630 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.139543 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="70df8642-31f3-4891-a50a-9321926651f1" containerName="console" Jul 06 20:15:00.139630 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.139615 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="70df8642-31f3-4891-a50a-9321926651f1" containerName="console" Jul 06 20:15:00.142752 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.142729 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" Jul 06 20:15:00.159675 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.159619 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722815-prbrb"] Jul 06 20:15:00.241768 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.241732 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hx95\" (UniqueName: \"kubernetes.io/projected/3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0-kube-api-access-5hx95\") pod \"maas-api-key-cleanup-29722815-prbrb\" (UID: \"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0\") " pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" Jul 06 20:15:00.342944 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.342907 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hx95\" (UniqueName: \"kubernetes.io/projected/3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0-kube-api-access-5hx95\") pod \"maas-api-key-cleanup-29722815-prbrb\" (UID: \"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0\") " pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" Jul 06 20:15:00.351356 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.351329 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hx95\" (UniqueName: \"kubernetes.io/projected/3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0-kube-api-access-5hx95\") pod \"maas-api-key-cleanup-29722815-prbrb\" (UID: \"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0\") " pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" Jul 06 20:15:00.453756 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.453725 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" Jul 06 20:15:00.596168 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.596137 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722815-prbrb"] Jul 06 20:15:00.598600 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:15:00.598575 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ba53ae0_ac7e_452a_b4d9_7d8ca3709bc0.slice/crio-f8252ddab604c1fc292ac82e5b0d469346131c29e491f60a4a0cd496337e21fd WatchSource:0}: Error finding container f8252ddab604c1fc292ac82e5b0d469346131c29e491f60a4a0cd496337e21fd: Status 404 returned error can't find the container with id f8252ddab604c1fc292ac82e5b0d469346131c29e491f60a4a0cd496337e21fd Jul 06 20:15:00.601214 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:00.601198 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:15:01.300677 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:01.300619 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" event={"ID":"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0","Type":"ContainerStarted","Data":"f8252ddab604c1fc292ac82e5b0d469346131c29e491f60a4a0cd496337e21fd"} Jul 06 20:15:04.319249 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:04.319210 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" event={"ID":"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0","Type":"ContainerStarted","Data":"c2630d4e000cc8b986a03372b7bd2a9d150a2ff9c48a70f380feebfe6873fcb6"} Jul 06 20:15:04.336853 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:04.336804 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" podStartSLOduration=1.0660697670000001 podStartE2EDuration="4.336789746s" totalImagesPullingTime="3.270719979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:15:04.334815497 +0000 UTC m=+1487.605569799" watchObservedRunningTime="2026-07-06 20:15:04.336789746 +0000 UTC m=+1487.607544047" Jul 06 20:15:05.326314 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:05.326283 2558 generic.go:356] "Generic (PLEG): container finished" podID="3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0" containerID="c2630d4e000cc8b986a03372b7bd2a9d150a2ff9c48a70f380feebfe6873fcb6" exitCode=0 Jul 06 20:15:05.326721 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:05.326371 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" event={"ID":"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0","Type":"ContainerDied","Data":"c2630d4e000cc8b986a03372b7bd2a9d150a2ff9c48a70f380feebfe6873fcb6"} Jul 06 20:15:06.469237 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:06.469215 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" Jul 06 20:15:06.601835 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:06.601746 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hx95\" (UniqueName: \"kubernetes.io/projected/3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0-kube-api-access-5hx95\") pod \"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0\" (UID: \"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0\") " Jul 06 20:15:06.603776 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:06.603746 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0-kube-api-access-5hx95" (OuterVolumeSpecName: "kube-api-access-5hx95") pod "3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0" (UID: "3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0"). InnerVolumeSpecName "kube-api-access-5hx95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:15:06.703436 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:06.703399 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hx95\" (UniqueName: \"kubernetes.io/projected/3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0-kube-api-access-5hx95\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:15:07.337969 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:07.337944 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" Jul 06 20:15:07.338130 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:07.337964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722815-prbrb" event={"ID":"3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0","Type":"ContainerDied","Data":"f8252ddab604c1fc292ac82e5b0d469346131c29e491f60a4a0cd496337e21fd"} Jul 06 20:15:07.338130 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:07.338010 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f8252ddab604c1fc292ac82e5b0d469346131c29e491f60a4a0cd496337e21fd" Jul 06 20:15:17.243208 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:17.243164 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:15:17.247463 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:15:17.247437 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:19:08.711284 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.711250 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw"] Jul 06 20:19:08.711732 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.711703 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0" containerName="cleanup" Jul 06 20:19:08.711732 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.711716 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0" containerName="cleanup" Jul 06 20:19:08.711829 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.711819 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0" containerName="cleanup" Jul 06 20:19:08.715263 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.715242 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.718427 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.718405 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-782907f8-openshift-default-dockercfg-zb8gj\"" Jul 06 20:19:08.740376 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.740345 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw"] Jul 06 20:19:08.781820 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.781782 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-envoy\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.781986 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.781839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-socket\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.781986 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.781931 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-data\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.781986 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.781970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-podinfo\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.782094 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.781997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4jwk\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-kube-api-access-c4jwk\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.782094 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.782035 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-certs\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.782094 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.782071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-credential-socket\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.782094 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.782090 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62da856e-60c5-409b-b7b3-50e43a593fb2-istiod-ca-cert\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.782230 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.782107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-token\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.882986 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.882941 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-data\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883175 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-podinfo\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883175 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4jwk\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-kube-api-access-c4jwk\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883175 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883072 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-certs\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883175 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883120 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-credential-socket\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883175 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62da856e-60c5-409b-b7b3-50e43a593fb2-istiod-ca-cert\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883434 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883182 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-token\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883434 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-envoy\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883434 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-socket\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883595 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883439 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-data\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883595 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-certs\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883595 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-socket\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883799 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-credential-socket\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.883958 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.883937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62da856e-60c5-409b-b7b3-50e43a593fb2-istiod-ca-cert\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.885474 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.885447 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-envoy\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.885474 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.885467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-podinfo\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.890922 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.890901 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-token\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:08.891115 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:08.891095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4jwk\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-kube-api-access-c4jwk\") pod \"e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:09.026180 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.026088 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:09.173484 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.173457 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw"] Jul 06 20:19:09.175520 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:19:09.175483 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62da856e_60c5_409b_b7b3_50e43a593fb2.slice/crio-16aa27918c1bbacd16410588a31e062fd2397db257ff9254eea8dd0cd1a42994 WatchSource:0}: Error finding container 16aa27918c1bbacd16410588a31e062fd2397db257ff9254eea8dd0cd1a42994: Status 404 returned error can't find the container with id 16aa27918c1bbacd16410588a31e062fd2397db257ff9254eea8dd0cd1a42994 Jul 06 20:19:09.177796 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.177761 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:19:09.177908 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.177842 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:19:09.177908 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.177888 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:19:09.659079 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.659042 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" event={"ID":"62da856e-60c5-409b-b7b3-50e43a593fb2","Type":"ContainerStarted","Data":"de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357"} Jul 06 20:19:09.659307 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.659104 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" event={"ID":"62da856e-60c5-409b-b7b3-50e43a593fb2","Type":"ContainerStarted","Data":"16aa27918c1bbacd16410588a31e062fd2397db257ff9254eea8dd0cd1a42994"} Jul 06 20:19:09.682761 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:09.682710 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" podStartSLOduration=1.6826932079999999 podStartE2EDuration="1.682693208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:09.680014307 +0000 UTC m=+1732.950768609" watchObservedRunningTime="2026-07-06 20:19:09.682693208 +0000 UTC m=+1732.953447508" Jul 06 20:19:10.026285 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:10.026248 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:10.031249 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:10.031223 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:10.664552 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:10.664519 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:10.665384 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:10.665363 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:15.085986 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:15.085941 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw"] Jul 06 20:19:15.086452 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:15.086183 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" podUID="62da856e-60c5-409b-b7b3-50e43a593fb2" containerName="istio-proxy" containerID="cri-o://de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357" gracePeriod=30 Jul 06 20:19:20.340315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.340284 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:20.399949 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.399860 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-podinfo\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.399949 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.399943 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62da856e-60c5-409b-b7b3-50e43a593fb2-istiod-ca-cert\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400163 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.399967 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-envoy\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400163 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400000 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-token\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400163 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400030 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-certs\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400163 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400054 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-credential-socket\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400163 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400132 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-socket\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400163 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400159 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4jwk\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-kube-api-access-c4jwk\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400482 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400192 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-data\") pod \"62da856e-60c5-409b-b7b3-50e43a593fb2\" (UID: \"62da856e-60c5-409b-b7b3-50e43a593fb2\") " Jul 06 20:19:20.400482 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400371 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62da856e-60c5-409b-b7b3-50e43a593fb2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:19:20.400482 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400436 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:20.400482 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400449 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:20.400724 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400625 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:20.400724 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400688 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-socket\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.400724 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400710 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-data" (OuterVolumeSpecName: "istio-data") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:20.400891 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400722 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62da856e-60c5-409b-b7b3-50e43a593fb2-istiod-ca-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.400891 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.400769 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-credential-socket\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.402335 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.402294 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:20.402445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.402349 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-kube-api-access-c4jwk" (OuterVolumeSpecName: "kube-api-access-c4jwk") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "kube-api-access-c4jwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:19:20.402445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.402363 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:19:20.402445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.402371 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "62da856e-60c5-409b-b7b3-50e43a593fb2" (UID: "62da856e-60c5-409b-b7b3-50e43a593fb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:19:20.501363 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.501335 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-workload-certs\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.501363 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.501359 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4jwk\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-kube-api-access-c4jwk\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.501363 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.501369 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-data\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.501570 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.501377 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-podinfo\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.501570 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.501386 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-envoy\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.501570 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.501395 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62da856e-60c5-409b-b7b3-50e43a593fb2-istio-token\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:20.719589 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.719551 2558 generic.go:356] "Generic (PLEG): container finished" podID="62da856e-60c5-409b-b7b3-50e43a593fb2" containerID="de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357" exitCode=0 Jul 06 20:19:20.719772 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.719603 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" Jul 06 20:19:20.719772 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.719602 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" event={"ID":"62da856e-60c5-409b-b7b3-50e43a593fb2","Type":"ContainerDied","Data":"de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357"} Jul 06 20:19:20.719772 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.719738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw" event={"ID":"62da856e-60c5-409b-b7b3-50e43a593fb2","Type":"ContainerDied","Data":"16aa27918c1bbacd16410588a31e062fd2397db257ff9254eea8dd0cd1a42994"} Jul 06 20:19:20.719886 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.719773 2558 scope.go:117] "RemoveContainer" containerID="de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357" Jul 06 20:19:20.729536 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.729520 2558 scope.go:117] "RemoveContainer" containerID="de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357" Jul 06 20:19:20.729796 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:19:20.729780 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357\": container with ID starting with de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357 not found: ID does not exist" containerID="de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357" Jul 06 20:19:20.729851 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.729802 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357"} err="failed to get container status \"de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357\": rpc error: code = NotFound desc = could not find container \"de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357\": container with ID starting with de1a186616edcd99f0fb03f522639a4a7fc163f8de4927e20664fc6fc18da357 not found: ID does not exist" Jul 06 20:19:20.741329 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.741307 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw"] Jul 06 20:19:20.744997 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:20.744976 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-782907f8-openshift-default-66fc9dbd97-4hxsw"] Jul 06 20:19:21.321798 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:21.321715 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62da856e-60c5-409b-b7b3-50e43a593fb2" path="/var/lib/kubelet/pods/62da856e-60c5-409b-b7b3-50e43a593fb2/volumes" Jul 06 20:19:22.414833 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.414794 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf"] Jul 06 20:19:22.415495 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.415473 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62da856e-60c5-409b-b7b3-50e43a593fb2" containerName="istio-proxy" Jul 06 20:19:22.415619 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.415498 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="62da856e-60c5-409b-b7b3-50e43a593fb2" containerName="istio-proxy" Jul 06 20:19:22.415619 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.415603 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="62da856e-60c5-409b-b7b3-50e43a593fb2" containerName="istio-proxy" Jul 06 20:19:22.425980 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.425958 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.428439 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.428416 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-11e70696-serving-cert\"" Jul 06 20:19:22.435137 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.435115 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf"] Jul 06 20:19:22.521602 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.521557 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/defe840e-932e-4a2b-ae91-245c8b55be62-maas-api-tls\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.521802 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.521715 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/defe840e-932e-4a2b-ae91-245c8b55be62-openshift-service-ca\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.521802 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.521739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4phv5\" (UniqueName: \"kubernetes.io/projected/defe840e-932e-4a2b-ae91-245c8b55be62-kube-api-access-4phv5\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.623007 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.622883 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/defe840e-932e-4a2b-ae91-245c8b55be62-openshift-service-ca\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.623007 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.622924 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4phv5\" (UniqueName: \"kubernetes.io/projected/defe840e-932e-4a2b-ae91-245c8b55be62-kube-api-access-4phv5\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.623007 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.622978 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/defe840e-932e-4a2b-ae91-245c8b55be62-maas-api-tls\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.645569 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.623529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/defe840e-932e-4a2b-ae91-245c8b55be62-openshift-service-ca\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.645569 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.625330 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/defe840e-932e-4a2b-ae91-245c8b55be62-maas-api-tls\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.645569 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.630909 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4phv5\" (UniqueName: \"kubernetes.io/projected/defe840e-932e-4a2b-ae91-245c8b55be62-kube-api-access-4phv5\") pod \"maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.740717 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.740612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:22.882749 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:22.882715 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf"] Jul 06 20:19:22.886598 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:19:22.886564 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefe840e_932e_4a2b_ae91_245c8b55be62.slice/crio-88777f3468cd2a3440c7be736fb1d871c207714926d4ae304d2bd6562924ab28 WatchSource:0}: Error finding container 88777f3468cd2a3440c7be736fb1d871c207714926d4ae304d2bd6562924ab28: Status 404 returned error can't find the container with id 88777f3468cd2a3440c7be736fb1d871c207714926d4ae304d2bd6562924ab28 Jul 06 20:19:23.741315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:23.741280 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" event={"ID":"defe840e-932e-4a2b-ae91-245c8b55be62","Type":"ContainerStarted","Data":"d91fd91aee7f8d402cb5bee06a771e01d493e3407cbbc9204039cab96cc79f46"} Jul 06 20:19:23.741752 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:23.741343 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:23.741752 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:23.741365 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" event={"ID":"defe840e-932e-4a2b-ae91-245c8b55be62","Type":"ContainerStarted","Data":"88777f3468cd2a3440c7be736fb1d871c207714926d4ae304d2bd6562924ab28"} Jul 06 20:19:23.760299 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:23.760254 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" podStartSLOduration=1.309756551 podStartE2EDuration="1.760238658s" totalImagesPullingTime="450.482107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:23.758014729 +0000 UTC m=+1747.028769030" watchObservedRunningTime="2026-07-06 20:19:23.760238658 +0000 UTC m=+1747.030992987" Jul 06 20:19:27.582469 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.582435 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf"] Jul 06 20:19:27.582946 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.582682 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" podUID="defe840e-932e-4a2b-ae91-245c8b55be62" containerName="maas-api" containerID="cri-o://d91fd91aee7f8d402cb5bee06a771e01d493e3407cbbc9204039cab96cc79f46" gracePeriod=30 Jul 06 20:19:27.767133 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.767103 2558 generic.go:356] "Generic (PLEG): container finished" podID="defe840e-932e-4a2b-ae91-245c8b55be62" containerID="d91fd91aee7f8d402cb5bee06a771e01d493e3407cbbc9204039cab96cc79f46" exitCode=0 Jul 06 20:19:27.767310 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.767157 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" event={"ID":"defe840e-932e-4a2b-ae91-245c8b55be62","Type":"ContainerDied","Data":"d91fd91aee7f8d402cb5bee06a771e01d493e3407cbbc9204039cab96cc79f46"} Jul 06 20:19:27.838390 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.838321 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:27.971839 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.971803 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4phv5\" (UniqueName: \"kubernetes.io/projected/defe840e-932e-4a2b-ae91-245c8b55be62-kube-api-access-4phv5\") pod \"defe840e-932e-4a2b-ae91-245c8b55be62\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " Jul 06 20:19:27.972035 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.971880 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/defe840e-932e-4a2b-ae91-245c8b55be62-openshift-service-ca\") pod \"defe840e-932e-4a2b-ae91-245c8b55be62\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " Jul 06 20:19:27.972035 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.971908 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/defe840e-932e-4a2b-ae91-245c8b55be62-maas-api-tls\") pod \"defe840e-932e-4a2b-ae91-245c8b55be62\" (UID: \"defe840e-932e-4a2b-ae91-245c8b55be62\") " Jul 06 20:19:27.972254 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.972223 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defe840e-932e-4a2b-ae91-245c8b55be62-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "defe840e-932e-4a2b-ae91-245c8b55be62" (UID: "defe840e-932e-4a2b-ae91-245c8b55be62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:19:27.973972 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.973945 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defe840e-932e-4a2b-ae91-245c8b55be62-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "defe840e-932e-4a2b-ae91-245c8b55be62" (UID: "defe840e-932e-4a2b-ae91-245c8b55be62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:19:27.974075 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:27.974005 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defe840e-932e-4a2b-ae91-245c8b55be62-kube-api-access-4phv5" (OuterVolumeSpecName: "kube-api-access-4phv5") pod "defe840e-932e-4a2b-ae91-245c8b55be62" (UID: "defe840e-932e-4a2b-ae91-245c8b55be62"). InnerVolumeSpecName "kube-api-access-4phv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:19:28.073666 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.073610 2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/defe840e-932e-4a2b-ae91-245c8b55be62-maas-api-tls\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:28.073666 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.073655 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4phv5\" (UniqueName: \"kubernetes.io/projected/defe840e-932e-4a2b-ae91-245c8b55be62-kube-api-access-4phv5\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:28.073666 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.073667 2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/defe840e-932e-4a2b-ae91-245c8b55be62-openshift-service-ca\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:28.773973 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.773946 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" Jul 06 20:19:28.773973 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.773962 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf" event={"ID":"defe840e-932e-4a2b-ae91-245c8b55be62","Type":"ContainerDied","Data":"88777f3468cd2a3440c7be736fb1d871c207714926d4ae304d2bd6562924ab28"} Jul 06 20:19:28.774442 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.774016 2558 scope.go:117] "RemoveContainer" containerID="d91fd91aee7f8d402cb5bee06a771e01d493e3407cbbc9204039cab96cc79f46" Jul 06 20:19:28.795714 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.795689 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf"] Jul 06 20:19:28.801474 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:28.801450 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-11e70696-5ff689cfdb-r8pwf"] Jul 06 20:19:29.320658 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:29.320618 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="defe840e-932e-4a2b-ae91-245c8b55be62" path="/var/lib/kubelet/pods/defe840e-932e-4a2b-ae91-245c8b55be62/volumes" Jul 06 20:19:39.485831 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.485795 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl"] Jul 06 20:19:39.486735 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.486711 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="defe840e-932e-4a2b-ae91-245c8b55be62" containerName="maas-api" Jul 06 20:19:39.486735 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.486735 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="defe840e-932e-4a2b-ae91-245c8b55be62" containerName="maas-api" Jul 06 20:19:39.486933 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.486830 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="defe840e-932e-4a2b-ae91-245c8b55be62" containerName="maas-api" Jul 06 20:19:39.491875 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.491857 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.494338 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.494317 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-373ca5d7-openshift-default-dockercfg-pzn2m\"" Jul 06 20:19:39.502362 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.502335 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl"] Jul 06 20:19:39.682825 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.682796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-credential-socket\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.682825 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.682829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-envoy\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.683033 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.682863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-socket\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.683033 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.682884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03036e76-23b1-4a7d-b02c-27588134844f-istiod-ca-cert\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.683033 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.682908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-data\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.683033 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.682929 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03036e76-23b1-4a7d-b02c-27588134844f-istio-podinfo\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.683033 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.682967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-certs\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.683033 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.683010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bdn4\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-kube-api-access-4bdn4\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.683227 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.683037 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-istio-token\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784021 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.783943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-certs\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784021 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.783981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bdn4\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-kube-api-access-4bdn4\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784021 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-istio-token\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-credential-socket\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784095 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-envoy\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-socket\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784138 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03036e76-23b1-4a7d-b02c-27588134844f-istiod-ca-cert\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-data\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784180 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03036e76-23b1-4a7d-b02c-27588134844f-istio-podinfo\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784696 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-credential-socket\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784696 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784558 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-certs\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784696 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-socket\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.784896 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784727 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-data\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.785018 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.784997 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03036e76-23b1-4a7d-b02c-27588134844f-istiod-ca-cert\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.786456 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.786435 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-envoy\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.786755 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.786738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03036e76-23b1-4a7d-b02c-27588134844f-istio-podinfo\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.792083 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.792061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bdn4\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-kube-api-access-4bdn4\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.792429 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.792409 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-istio-token\") pod \"e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.804425 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.804402 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:39.947441 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.947409 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl"] Jul 06 20:19:39.949654 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:19:39.949611 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03036e76_23b1_4a7d_b02c_27588134844f.slice/crio-ce4bfc896d8cb3c3be17f914353a010e6c956e5beaf6bef689d95ad6fd6a821c WatchSource:0}: Error finding container ce4bfc896d8cb3c3be17f914353a010e6c956e5beaf6bef689d95ad6fd6a821c: Status 404 returned error can't find the container with id ce4bfc896d8cb3c3be17f914353a010e6c956e5beaf6bef689d95ad6fd6a821c Jul 06 20:19:39.952183 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.952147 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:19:39.952257 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.952218 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:19:39.952257 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:39.952248 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 20:19:40.849228 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:40.849196 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" event={"ID":"03036e76-23b1-4a7d-b02c-27588134844f","Type":"ContainerStarted","Data":"5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363"} Jul 06 20:19:40.849695 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:40.849245 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" event={"ID":"03036e76-23b1-4a7d-b02c-27588134844f","Type":"ContainerStarted","Data":"ce4bfc896d8cb3c3be17f914353a010e6c956e5beaf6bef689d95ad6fd6a821c"} Jul 06 20:19:40.874337 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:40.874273 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" podStartSLOduration=1.874253827 podStartE2EDuration="1.874253827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:19:40.872033321 +0000 UTC m=+1764.142787623" watchObservedRunningTime="2026-07-06 20:19:40.874253827 +0000 UTC m=+1764.145008129" Jul 06 20:19:41.804847 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:41.804813 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:41.810230 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:41.810204 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:41.854974 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:41.854940 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:41.855782 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:41.855764 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:45.285660 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:45.284875 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl"] Jul 06 20:19:45.285660 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:45.285111 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" podUID="03036e76-23b1-4a7d-b02c-27588134844f" containerName="istio-proxy" containerID="cri-o://5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363" gracePeriod=30 Jul 06 20:19:51.647568 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.647544 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:51.707615 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707586 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-istio-token\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.707821 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707680 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-socket\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.707821 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707771 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03036e76-23b1-4a7d-b02c-27588134844f-istio-podinfo\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.707821 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707814 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bdn4\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-kube-api-access-4bdn4\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.708000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707871 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-certs\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.708000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707901 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-credential-socket\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.708000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707939 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-envoy\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.708000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707952 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:51.708000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707975 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03036e76-23b1-4a7d-b02c-27588134844f-istiod-ca-cert\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.708000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.707998 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-data\") pod \"03036e76-23b1-4a7d-b02c-27588134844f\" (UID: \"03036e76-23b1-4a7d-b02c-27588134844f\") " Jul 06 20:19:51.708361 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.708283 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:51.708438 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.708400 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03036e76-23b1-4a7d-b02c-27588134844f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:19:51.708560 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.708512 2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-credential-socket\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.708560 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.708534 2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-socket\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.708746 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.708558 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:51.709283 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.709257 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-data" (OuterVolumeSpecName: "istio-data") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:51.710208 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.710186 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-kube-api-access-4bdn4" (OuterVolumeSpecName: "kube-api-access-4bdn4") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "kube-api-access-4bdn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:19:51.710360 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.710337 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 20:19:51.710416 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.710359 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-istio-token" (OuterVolumeSpecName: "istio-token") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:19:51.710457 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.710410 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03036e76-23b1-4a7d-b02c-27588134844f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "03036e76-23b1-4a7d-b02c-27588134844f" (UID: "03036e76-23b1-4a7d-b02c-27588134844f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 06 20:19:51.809089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.809055 2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-workload-certs\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.809089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.809082 2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-envoy\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.809089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.809092 2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03036e76-23b1-4a7d-b02c-27588134844f-istiod-ca-cert\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.809315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.809099 2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03036e76-23b1-4a7d-b02c-27588134844f-istio-data\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.809315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.809107 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-istio-token\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.809315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.809116 2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03036e76-23b1-4a7d-b02c-27588134844f-istio-podinfo\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.809315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.809126 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bdn4\" (UniqueName: \"kubernetes.io/projected/03036e76-23b1-4a7d-b02c-27588134844f-kube-api-access-4bdn4\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:19:51.935731 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.935694 2558 generic.go:356] "Generic (PLEG): container finished" podID="03036e76-23b1-4a7d-b02c-27588134844f" containerID="5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363" exitCode=0 Jul 06 20:19:51.935899 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.935758 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" Jul 06 20:19:51.935899 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.935776 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" event={"ID":"03036e76-23b1-4a7d-b02c-27588134844f","Type":"ContainerDied","Data":"5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363"} Jul 06 20:19:51.935899 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.935866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl" event={"ID":"03036e76-23b1-4a7d-b02c-27588134844f","Type":"ContainerDied","Data":"ce4bfc896d8cb3c3be17f914353a010e6c956e5beaf6bef689d95ad6fd6a821c"} Jul 06 20:19:51.935899 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.935896 2558 scope.go:117] "RemoveContainer" containerID="5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363" Jul 06 20:19:51.945734 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.945717 2558 scope.go:117] "RemoveContainer" containerID="5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363" Jul 06 20:19:51.945989 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:19:51.945971 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363\": container with ID starting with 5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363 not found: ID does not exist" containerID="5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363" Jul 06 20:19:51.946039 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.945997 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363"} err="failed to get container status \"5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363\": rpc error: code = NotFound desc = could not find container \"5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363\": container with ID starting with 5a4ea7903aa260c0e0c059226452ab9a1e84a81bee944f4e1e6ea183f251c363 not found: ID does not exist" Jul 06 20:19:51.961453 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.961431 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl"] Jul 06 20:19:51.966496 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:51.966442 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-373ca5d7-openshift-default-859f57bbc-dlhdl"] Jul 06 20:19:53.321801 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:19:53.321760 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03036e76-23b1-4a7d-b02c-27588134844f" path="/var/lib/kubelet/pods/03036e76-23b1-4a7d-b02c-27588134844f/volumes" Jul 06 20:20:17.276344 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:20:17.276316 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:20:17.282652 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:20:17.282616 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:25:17.309931 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:25:17.309897 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:25:17.318785 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:25:17.318764 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:27:23.565522 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.565476 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d"] Jul 06 20:27:23.566150 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.566130 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03036e76-23b1-4a7d-b02c-27588134844f" containerName="istio-proxy" Jul 06 20:27:23.566221 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.566152 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="03036e76-23b1-4a7d-b02c-27588134844f" containerName="istio-proxy" Jul 06 20:27:23.566280 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.566256 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="03036e76-23b1-4a7d-b02c-27588134844f" containerName="istio-proxy" Jul 06 20:27:23.569832 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.569812 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.573701 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.573680 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-482add-serving-cert\"" Jul 06 20:27:23.586698 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.586668 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d"] Jul 06 20:27:23.664327 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.664292 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4a1599-66b6-4260-a5b7-23faa6e28e73-openshift-service-ca\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.664491 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.664334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/bb4a1599-66b6-4260-a5b7-23faa6e28e73-kube-api-access-4hw5t\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.664491 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.664403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4a1599-66b6-4260-a5b7-23faa6e28e73-maas-api-tls\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.765239 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.765200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4a1599-66b6-4260-a5b7-23faa6e28e73-maas-api-tls\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.765448 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.765341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4a1599-66b6-4260-a5b7-23faa6e28e73-openshift-service-ca\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.765448 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.765391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/bb4a1599-66b6-4260-a5b7-23faa6e28e73-kube-api-access-4hw5t\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.766071 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.766042 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4a1599-66b6-4260-a5b7-23faa6e28e73-openshift-service-ca\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.767995 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.767973 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4a1599-66b6-4260-a5b7-23faa6e28e73-maas-api-tls\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.773216 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.773193 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/bb4a1599-66b6-4260-a5b7-23faa6e28e73-kube-api-access-4hw5t\") pod \"maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:23.883003 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:23.882923 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:24.037194 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:24.037169 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d"] Jul 06 20:27:24.039272 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:27:24.039246 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4a1599_66b6_4260_a5b7_23faa6e28e73.slice/crio-1ad24d86a4133e227a71b0df11035d66e545df5f06ddde573ede1ba79116143f WatchSource:0}: Error finding container 1ad24d86a4133e227a71b0df11035d66e545df5f06ddde573ede1ba79116143f: Status 404 returned error can't find the container with id 1ad24d86a4133e227a71b0df11035d66e545df5f06ddde573ede1ba79116143f Jul 06 20:27:24.040690 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:24.040673 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 20:27:24.381989 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:24.381946 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" event={"ID":"bb4a1599-66b6-4260-a5b7-23faa6e28e73","Type":"ContainerStarted","Data":"1ad24d86a4133e227a71b0df11035d66e545df5f06ddde573ede1ba79116143f"} Jul 06 20:27:25.390037 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:25.389998 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" event={"ID":"bb4a1599-66b6-4260-a5b7-23faa6e28e73","Type":"ContainerStarted","Data":"df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580"} Jul 06 20:27:25.390469 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:25.390169 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:27:25.409696 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:25.409631 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" podStartSLOduration=2.041000858 podStartE2EDuration="2.409615891s" totalImagesPullingTime="368.615033ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:27:25.407805588 +0000 UTC m=+2228.678559927" watchObservedRunningTime="2026-07-06 20:27:25.409615891 +0000 UTC m=+2228.680370192" Jul 06 20:27:31.405279 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:27:31.405234 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:30:00.134055 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.134018 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722830-mz7nb"] Jul 06 20:30:00.137858 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.137833 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2"] Jul 06 20:30:00.137986 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.137968 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" Jul 06 20:30:00.141051 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.141032 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft"] Jul 06 20:30:00.141169 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.141154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" Jul 06 20:30:00.144340 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.144323 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" Jul 06 20:30:00.163517 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.163483 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2"] Jul 06 20:30:00.194059 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.194010 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722830-mz7nb"] Jul 06 20:30:00.236260 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.236223 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft"] Jul 06 20:30:00.282938 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.282905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgtpk\" (UniqueName: \"kubernetes.io/projected/73cd54ed-0bb9-4c2f-801d-b2602a5f4785-kube-api-access-bgtpk\") pod \"maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft\" (UID: \"73cd54ed-0bb9-4c2f-801d-b2602a5f4785\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" Jul 06 20:30:00.283096 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.282954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4k76\" (UniqueName: \"kubernetes.io/projected/f10c5ccd-2fb3-4b1d-aea9-66812d147aca-kube-api-access-g4k76\") pod \"maas-api-key-cleanup-29722830-mz7nb\" (UID: \"f10c5ccd-2fb3-4b1d-aea9-66812d147aca\") " pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" Jul 06 20:30:00.283096 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.283066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvt8\" (UniqueName: \"kubernetes.io/projected/c56c2def-d849-4e9e-b28e-f5a620896904-kube-api-access-7bvt8\") pod \"maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2\" (UID: \"c56c2def-d849-4e9e-b28e-f5a620896904\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" Jul 06 20:30:00.384725 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.384605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvt8\" (UniqueName: \"kubernetes.io/projected/c56c2def-d849-4e9e-b28e-f5a620896904-kube-api-access-7bvt8\") pod \"maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2\" (UID: \"c56c2def-d849-4e9e-b28e-f5a620896904\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" Jul 06 20:30:00.384925 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.384746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgtpk\" (UniqueName: \"kubernetes.io/projected/73cd54ed-0bb9-4c2f-801d-b2602a5f4785-kube-api-access-bgtpk\") pod \"maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft\" (UID: \"73cd54ed-0bb9-4c2f-801d-b2602a5f4785\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" Jul 06 20:30:00.384925 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.384810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4k76\" (UniqueName: \"kubernetes.io/projected/f10c5ccd-2fb3-4b1d-aea9-66812d147aca-kube-api-access-g4k76\") pod \"maas-api-key-cleanup-29722830-mz7nb\" (UID: \"f10c5ccd-2fb3-4b1d-aea9-66812d147aca\") " pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" Jul 06 20:30:00.393195 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.393159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4k76\" (UniqueName: \"kubernetes.io/projected/f10c5ccd-2fb3-4b1d-aea9-66812d147aca-kube-api-access-g4k76\") pod \"maas-api-key-cleanup-29722830-mz7nb\" (UID: \"f10c5ccd-2fb3-4b1d-aea9-66812d147aca\") " pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" Jul 06 20:30:00.393195 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.393181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvt8\" (UniqueName: \"kubernetes.io/projected/c56c2def-d849-4e9e-b28e-f5a620896904-kube-api-access-7bvt8\") pod \"maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2\" (UID: \"c56c2def-d849-4e9e-b28e-f5a620896904\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" Jul 06 20:30:00.393399 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.393313 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgtpk\" (UniqueName: \"kubernetes.io/projected/73cd54ed-0bb9-4c2f-801d-b2602a5f4785-kube-api-access-bgtpk\") pod \"maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft\" (UID: \"73cd54ed-0bb9-4c2f-801d-b2602a5f4785\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" Jul 06 20:30:00.449372 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.449337 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" Jul 06 20:30:00.458418 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.458387 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" Jul 06 20:30:00.463251 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.463231 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" Jul 06 20:30:00.626315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.626280 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2"] Jul 06 20:30:00.629817 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:30:00.629784 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56c2def_d849_4e9e_b28e_f5a620896904.slice/crio-34726db69864f6511561ee7a3cab049a66201976da58ee2568617915bedd36f9 WatchSource:0}: Error finding container 34726db69864f6511561ee7a3cab049a66201976da58ee2568617915bedd36f9: Status 404 returned error can't find the container with id 34726db69864f6511561ee7a3cab049a66201976da58ee2568617915bedd36f9 Jul 06 20:30:00.846532 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.846502 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722830-mz7nb"] Jul 06 20:30:00.848495 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:30:00.848468 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf10c5ccd_2fb3_4b1d_aea9_66812d147aca.slice/crio-b2dfa576d108ff8a16c64658489c43723a04d480de6bc17f8992cf1afe87e0ea WatchSource:0}: Error finding container b2dfa576d108ff8a16c64658489c43723a04d480de6bc17f8992cf1afe87e0ea: Status 404 returned error can't find the container with id b2dfa576d108ff8a16c64658489c43723a04d480de6bc17f8992cf1afe87e0ea Jul 06 20:30:00.873376 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:00.873354 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft"] Jul 06 20:30:00.875817 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:30:00.875794 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cd54ed_0bb9_4c2f_801d_b2602a5f4785.slice/crio-606a8f556f52b3153ddad703af13011554dedadd2b6d0e38bfe999600e757daf WatchSource:0}: Error finding container 606a8f556f52b3153ddad703af13011554dedadd2b6d0e38bfe999600e757daf: Status 404 returned error can't find the container with id 606a8f556f52b3153ddad703af13011554dedadd2b6d0e38bfe999600e757daf Jul 06 20:30:01.242687 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.242648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" event={"ID":"f10c5ccd-2fb3-4b1d-aea9-66812d147aca","Type":"ContainerStarted","Data":"33f000dbb4d0cf3ed40a667ca67a86cbc62013777841e9694d3c31d9d66a70d7"} Jul 06 20:30:01.243147 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.242712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" event={"ID":"f10c5ccd-2fb3-4b1d-aea9-66812d147aca","Type":"ContainerStarted","Data":"b2dfa576d108ff8a16c64658489c43723a04d480de6bc17f8992cf1afe87e0ea"} Jul 06 20:30:01.244315 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.244286 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" event={"ID":"c56c2def-d849-4e9e-b28e-f5a620896904","Type":"ContainerStarted","Data":"ff340c69a83027a27c3a05c8114c529cade5b90f9093ce5bf85652d55467f9fc"} Jul 06 20:30:01.244448 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.244339 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" event={"ID":"c56c2def-d849-4e9e-b28e-f5a620896904","Type":"ContainerStarted","Data":"34726db69864f6511561ee7a3cab049a66201976da58ee2568617915bedd36f9"} Jul 06 20:30:01.245848 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.245822 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" event={"ID":"73cd54ed-0bb9-4c2f-801d-b2602a5f4785","Type":"ContainerStarted","Data":"fde041ce55d0a4c203c693581e1ca3f5565782f81b755c8e3c53810a5220de81"} Jul 06 20:30:01.245946 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.245862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" event={"ID":"73cd54ed-0bb9-4c2f-801d-b2602a5f4785","Type":"ContainerStarted","Data":"606a8f556f52b3153ddad703af13011554dedadd2b6d0e38bfe999600e757daf"} Jul 06 20:30:01.264403 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.264354 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" podStartSLOduration=1.2643397699999999 podStartE2EDuration="1.26433977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:01.263467468 +0000 UTC m=+2384.534221770" watchObservedRunningTime="2026-07-06 20:30:01.26433977 +0000 UTC m=+2384.535094070" Jul 06 20:30:01.284491 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.284438 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" podStartSLOduration=1.284426093 podStartE2EDuration="1.284426093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:01.283542388 +0000 UTC m=+2384.554296691" watchObservedRunningTime="2026-07-06 20:30:01.284426093 +0000 UTC m=+2384.555180393" Jul 06 20:30:01.304493 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:01.304441 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" podStartSLOduration=1.304424724 podStartE2EDuration="1.304424724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:30:01.302969258 +0000 UTC m=+2384.573723561" watchObservedRunningTime="2026-07-06 20:30:01.304424724 +0000 UTC m=+2384.575179025" Jul 06 20:30:02.253650 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:02.253540 2558 generic.go:356] "Generic (PLEG): container finished" podID="f10c5ccd-2fb3-4b1d-aea9-66812d147aca" containerID="33f000dbb4d0cf3ed40a667ca67a86cbc62013777841e9694d3c31d9d66a70d7" exitCode=0 Jul 06 20:30:02.254124 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:02.253627 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" event={"ID":"f10c5ccd-2fb3-4b1d-aea9-66812d147aca","Type":"ContainerDied","Data":"33f000dbb4d0cf3ed40a667ca67a86cbc62013777841e9694d3c31d9d66a70d7"} Jul 06 20:30:02.255091 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:02.255071 2558 generic.go:356] "Generic (PLEG): container finished" podID="c56c2def-d849-4e9e-b28e-f5a620896904" containerID="ff340c69a83027a27c3a05c8114c529cade5b90f9093ce5bf85652d55467f9fc" exitCode=0 Jul 06 20:30:02.255208 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:02.255143 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" event={"ID":"c56c2def-d849-4e9e-b28e-f5a620896904","Type":"ContainerDied","Data":"ff340c69a83027a27c3a05c8114c529cade5b90f9093ce5bf85652d55467f9fc"} Jul 06 20:30:02.256490 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:02.256469 2558 generic.go:356] "Generic (PLEG): container finished" podID="73cd54ed-0bb9-4c2f-801d-b2602a5f4785" containerID="fde041ce55d0a4c203c693581e1ca3f5565782f81b755c8e3c53810a5220de81" exitCode=0 Jul 06 20:30:02.256578 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:02.256496 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" event={"ID":"73cd54ed-0bb9-4c2f-801d-b2602a5f4785","Type":"ContainerDied","Data":"fde041ce55d0a4c203c693581e1ca3f5565782f81b755c8e3c53810a5220de81"} Jul 06 20:30:03.400320 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.400283 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" Jul 06 20:30:03.444182 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.444155 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" Jul 06 20:30:03.476540 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.476514 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" Jul 06 20:30:03.516932 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.516849 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgtpk\" (UniqueName: \"kubernetes.io/projected/73cd54ed-0bb9-4c2f-801d-b2602a5f4785-kube-api-access-bgtpk\") pod \"73cd54ed-0bb9-4c2f-801d-b2602a5f4785\" (UID: \"73cd54ed-0bb9-4c2f-801d-b2602a5f4785\") " Jul 06 20:30:03.516932 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.516930 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bvt8\" (UniqueName: \"kubernetes.io/projected/c56c2def-d849-4e9e-b28e-f5a620896904-kube-api-access-7bvt8\") pod \"c56c2def-d849-4e9e-b28e-f5a620896904\" (UID: \"c56c2def-d849-4e9e-b28e-f5a620896904\") " Jul 06 20:30:03.519005 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.518971 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73cd54ed-0bb9-4c2f-801d-b2602a5f4785-kube-api-access-bgtpk" (OuterVolumeSpecName: "kube-api-access-bgtpk") pod "73cd54ed-0bb9-4c2f-801d-b2602a5f4785" (UID: "73cd54ed-0bb9-4c2f-801d-b2602a5f4785"). InnerVolumeSpecName "kube-api-access-bgtpk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:30:03.519112 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.519009 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56c2def-d849-4e9e-b28e-f5a620896904-kube-api-access-7bvt8" (OuterVolumeSpecName: "kube-api-access-7bvt8") pod "c56c2def-d849-4e9e-b28e-f5a620896904" (UID: "c56c2def-d849-4e9e-b28e-f5a620896904"). InnerVolumeSpecName "kube-api-access-7bvt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:30:03.618501 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.618466 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4k76\" (UniqueName: \"kubernetes.io/projected/f10c5ccd-2fb3-4b1d-aea9-66812d147aca-kube-api-access-g4k76\") pod \"f10c5ccd-2fb3-4b1d-aea9-66812d147aca\" (UID: \"f10c5ccd-2fb3-4b1d-aea9-66812d147aca\") " Jul 06 20:30:03.618706 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.618694 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bvt8\" (UniqueName: \"kubernetes.io/projected/c56c2def-d849-4e9e-b28e-f5a620896904-kube-api-access-7bvt8\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:30:03.618759 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.618707 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgtpk\" (UniqueName: \"kubernetes.io/projected/73cd54ed-0bb9-4c2f-801d-b2602a5f4785-kube-api-access-bgtpk\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:30:03.620514 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.620492 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f10c5ccd-2fb3-4b1d-aea9-66812d147aca-kube-api-access-g4k76" (OuterVolumeSpecName: "kube-api-access-g4k76") pod "f10c5ccd-2fb3-4b1d-aea9-66812d147aca" (UID: "f10c5ccd-2fb3-4b1d-aea9-66812d147aca"). InnerVolumeSpecName "kube-api-access-g4k76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:30:03.719258 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:03.719222 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4k76\" (UniqueName: \"kubernetes.io/projected/f10c5ccd-2fb3-4b1d-aea9-66812d147aca-kube-api-access-g4k76\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:30:04.269004 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.268970 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" Jul 06 20:30:04.269004 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.268978 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2" event={"ID":"c56c2def-d849-4e9e-b28e-f5a620896904","Type":"ContainerDied","Data":"34726db69864f6511561ee7a3cab049a66201976da58ee2568617915bedd36f9"} Jul 06 20:30:04.269256 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.269059 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34726db69864f6511561ee7a3cab049a66201976da58ee2568617915bedd36f9" Jul 06 20:30:04.270324 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.270304 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" Jul 06 20:30:04.270450 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.270340 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft" event={"ID":"73cd54ed-0bb9-4c2f-801d-b2602a5f4785","Type":"ContainerDied","Data":"606a8f556f52b3153ddad703af13011554dedadd2b6d0e38bfe999600e757daf"} Jul 06 20:30:04.270450 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.270383 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="606a8f556f52b3153ddad703af13011554dedadd2b6d0e38bfe999600e757daf" Jul 06 20:30:04.271806 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.271788 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" Jul 06 20:30:04.271927 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.271779 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722830-mz7nb" event={"ID":"f10c5ccd-2fb3-4b1d-aea9-66812d147aca","Type":"ContainerDied","Data":"b2dfa576d108ff8a16c64658489c43723a04d480de6bc17f8992cf1afe87e0ea"} Jul 06 20:30:04.271927 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:04.271907 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2dfa576d108ff8a16c64658489c43723a04d480de6bc17f8992cf1afe87e0ea" Jul 06 20:30:17.344782 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:17.344670 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:30:17.365681 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:30:17.355058 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:33:01.623709 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:01.623606 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d"] Jul 06 20:33:01.624270 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:01.623884 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" podUID="bb4a1599-66b6-4260-a5b7-23faa6e28e73" containerName="maas-api" containerID="cri-o://df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580" gracePeriod=30 Jul 06 20:33:01.653583 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:01.653547 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft"] Jul 06 20:33:01.655796 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:01.655774 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-482add-29722830-b9mft"] Jul 06 20:33:02.075369 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.075347 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:33:02.126227 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.126193 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/bb4a1599-66b6-4260-a5b7-23faa6e28e73-kube-api-access-4hw5t\") pod \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " Jul 06 20:33:02.126391 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.126323 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4a1599-66b6-4260-a5b7-23faa6e28e73-maas-api-tls\") pod \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " Jul 06 20:33:02.126391 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.126370 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4a1599-66b6-4260-a5b7-23faa6e28e73-openshift-service-ca\") pod \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\" (UID: \"bb4a1599-66b6-4260-a5b7-23faa6e28e73\") " Jul 06 20:33:02.126721 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.126691 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb4a1599-66b6-4260-a5b7-23faa6e28e73-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb4a1599-66b6-4260-a5b7-23faa6e28e73" (UID: "bb4a1599-66b6-4260-a5b7-23faa6e28e73"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 20:33:02.128364 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.128335 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb4a1599-66b6-4260-a5b7-23faa6e28e73-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb4a1599-66b6-4260-a5b7-23faa6e28e73" (UID: "bb4a1599-66b6-4260-a5b7-23faa6e28e73"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 20:33:02.128474 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.128457 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb4a1599-66b6-4260-a5b7-23faa6e28e73-kube-api-access-4hw5t" (OuterVolumeSpecName: "kube-api-access-4hw5t") pod "bb4a1599-66b6-4260-a5b7-23faa6e28e73" (UID: "bb4a1599-66b6-4260-a5b7-23faa6e28e73"). InnerVolumeSpecName "kube-api-access-4hw5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 20:33:02.228116 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.228080 2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb4a1599-66b6-4260-a5b7-23faa6e28e73-maas-api-tls\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:33:02.228116 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.228112 2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb4a1599-66b6-4260-a5b7-23faa6e28e73-openshift-service-ca\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:33:02.228116 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.228123 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hw5t\" (UniqueName: \"kubernetes.io/projected/bb4a1599-66b6-4260-a5b7-23faa6e28e73-kube-api-access-4hw5t\") on node \"ip-10-0-135-185.ec2.internal\" DevicePath \"\"" Jul 06 20:33:02.263902 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.263873 2558 generic.go:356] "Generic (PLEG): container finished" podID="bb4a1599-66b6-4260-a5b7-23faa6e28e73" containerID="df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580" exitCode=0 Jul 06 20:33:02.264073 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.263917 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" Jul 06 20:33:02.264073 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.263957 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" event={"ID":"bb4a1599-66b6-4260-a5b7-23faa6e28e73","Type":"ContainerDied","Data":"df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580"} Jul 06 20:33:02.264073 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.264008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d" event={"ID":"bb4a1599-66b6-4260-a5b7-23faa6e28e73","Type":"ContainerDied","Data":"1ad24d86a4133e227a71b0df11035d66e545df5f06ddde573ede1ba79116143f"} Jul 06 20:33:02.264073 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.264029 2558 scope.go:117] "RemoveContainer" containerID="df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580" Jul 06 20:33:02.273402 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.273386 2558 scope.go:117] "RemoveContainer" containerID="df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580" Jul 06 20:33:02.273760 ip-10-0-135-185 kubenswrapper[2558]: E0706 20:33:02.273740 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580\": container with ID starting with df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580 not found: ID does not exist" containerID="df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580" Jul 06 20:33:02.273833 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.273769 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580"} err="failed to get container status \"df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580\": rpc error: code = NotFound desc = could not find container \"df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580\": container with ID starting with df22c969cb4beabd27a54b072edc6266decafbc9ea775a40d337ed0266228580 not found: ID does not exist" Jul 06 20:33:02.285217 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.285195 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d"] Jul 06 20:33:02.288556 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:02.288536 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-482add-5c5f5b9857-xlz2d"] Jul 06 20:33:03.320915 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:03.320878 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73cd54ed-0bb9-4c2f-801d-b2602a5f4785" path="/var/lib/kubelet/pods/73cd54ed-0bb9-4c2f-801d-b2602a5f4785/volumes" Jul 06 20:33:03.321393 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:03.321272 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb4a1599-66b6-4260-a5b7-23faa6e28e73" path="/var/lib/kubelet/pods/bb4a1599-66b6-4260-a5b7-23faa6e28e73/volumes" Jul 06 20:33:44.821426 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:44.821324 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2"] Jul 06 20:33:44.823387 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:44.823364 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-45b15a-29722830-kv8s2"] Jul 06 20:33:45.321384 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:45.321350 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56c2def-d849-4e9e-b28e-f5a620896904" path="/var/lib/kubelet/pods/c56c2def-d849-4e9e-b28e-f5a620896904/volumes" Jul 06 20:33:55.955002 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:55.954962 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69c479884b-bdm5q_9cb18cc1-c473-4810-96aa-59d4a3690a62/maas-api/0.log" Jul 06 20:33:56.063817 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:56.063789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722815-prbrb_3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0/cleanup/0.log" Jul 06 20:33:56.172624 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:56.172598 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722830-mz7nb_f10c5ccd-2fb3-4b1d-aea9-66812d147aca/cleanup/0.log" Jul 06 20:33:56.296480 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:56.296404 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-666975db4c-d8gz2_7d66c9a2-f9aa-43d2-8634-f136d382db90/manager/0.log" Jul 06 20:33:56.949715 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:56.949683 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-zzwnf_1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a/copy-manifests/0.log" Jul 06 20:33:56.956674 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:56.956623 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-zzwnf_1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a/manager/0.log" Jul 06 20:33:57.067419 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:57.067378 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mcsxz_729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec/postgres/0.log" Jul 06 20:33:58.485000 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:58.484961 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dkpfz_ac488e4c-75a1-4b48-a6df-ccd615d7f3d2/manager/0.log" Jul 06 20:33:58.595807 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:58.595779 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kmkdv_bec241d9-1529-4463-ae39-20ccc8f824d0/manager/0.log" Jul 06 20:33:58.829486 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:58.829408 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mb82v_5cb1ff06-e996-47e5-ab50-05c996325195/registry-server/0.log" Jul 06 20:33:59.552060 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:59.552028 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47vbks_79ee5e1d-3bf0-4f48-bd89-041fca088e36/istio-proxy/0.log" Jul 06 20:33:59.676980 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:59.676949 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rgkzn_4487d4f8-372a-42f4-a52f-cfe308214660/discovery/0.log" Jul 06 20:33:59.793408 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:33:59.793382 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-9cfx8_e7dcd51a-a418-41d2-bfd1-23715b6cc122/kube-auth-proxy/0.log" Jul 06 20:34:00.046329 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:00.046302 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bznwm_67011710-a339-4f0d-949b-eb210557c3d1/istio-proxy/1.log" Jul 06 20:34:00.284812 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:00.284778 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbhhg_40191def-f8c8-4bc3-b005-b666b02c837f/payload-processing/0.log" Jul 06 20:34:00.776708 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:00.776673 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-x99g9_c7722616-5e0f-4878-a107-bae3de41c0a1/main/0.log" Jul 06 20:34:00.892996 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:00.892957 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5fbs8_a68809b6-ba30-4920-93d5-2b2952c016b8/main/0.log" Jul 06 20:34:08.921504 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:08.921477 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vjlns_8716a40a-a752-453a-88e0-c096ed8ee208/global-pull-secret-syncer/0.log" Jul 06 20:34:09.051503 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:09.051469 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zq4sk_d0496c38-ac84-477d-b564-24abc184e8a7/konnectivity-agent/0.log" Jul 06 20:34:09.103130 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:09.103103 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-185.ec2.internal_8599849733ad70aaa09ca90f957a879d/haproxy/0.log" Jul 06 20:34:14.837782 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:14.837748 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dkpfz_ac488e4c-75a1-4b48-a6df-ccd615d7f3d2/manager/0.log" Jul 06 20:34:14.868096 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:14.868053 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kmkdv_bec241d9-1529-4463-ae39-20ccc8f824d0/manager/0.log" Jul 06 20:34:14.944055 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:14.944017 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mb82v_5cb1ff06-e996-47e5-ab50-05c996325195/registry-server/0.log" Jul 06 20:34:16.885684 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:16.885655 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9d517fc-7c0e-4586-be43-a51544621455/alertmanager/0.log" Jul 06 20:34:16.912252 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:16.912222 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9d517fc-7c0e-4586-be43-a51544621455/config-reloader/0.log" Jul 06 20:34:16.936826 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:16.936789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9d517fc-7c0e-4586-be43-a51544621455/kube-rbac-proxy-web/0.log" Jul 06 20:34:16.961086 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:16.961061 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9d517fc-7c0e-4586-be43-a51544621455/kube-rbac-proxy/0.log" Jul 06 20:34:16.986203 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:16.986178 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9d517fc-7c0e-4586-be43-a51544621455/kube-rbac-proxy-metric/0.log" Jul 06 20:34:17.012445 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.012417 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9d517fc-7c0e-4586-be43-a51544621455/prom-label-proxy/0.log" Jul 06 20:34:17.036980 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.036954 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b9d517fc-7c0e-4586-be43-a51544621455/init-config-reloader/0.log" Jul 06 20:34:17.515492 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.515464 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wwb88_f43b4637-c080-44e2-8654-f44cf0b16ac9/node-exporter/0.log" Jul 06 20:34:17.541979 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.541957 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wwb88_f43b4637-c080-44e2-8654-f44cf0b16ac9/kube-rbac-proxy/0.log" Jul 06 20:34:17.565468 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.565389 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wwb88_f43b4637-c080-44e2-8654-f44cf0b16ac9/init-textfile/0.log" Jul 06 20:34:17.594463 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.594432 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-mscsq_f0f03f40-9477-417e-af69-957f5fc01a38/kube-rbac-proxy-main/0.log" Jul 06 20:34:17.626776 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.626751 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-mscsq_f0f03f40-9477-417e-af69-957f5fc01a38/kube-rbac-proxy-self/0.log" Jul 06 20:34:17.649803 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.649778 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-mscsq_f0f03f40-9477-417e-af69-957f5fc01a38/openshift-state-metrics/0.log" Jul 06 20:34:17.923454 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.923428 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-f67tv_b884a383-b371-421c-9395-bcd35965a9a6/prometheus-operator-admission-webhook/0.log" Jul 06 20:34:17.954727 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.954700 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58d788f4fb-vjvp6_92d48476-b191-4bf8-ba9a-051b049d68e8/telemeter-client/0.log" Jul 06 20:34:17.981468 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:17.981444 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58d788f4fb-vjvp6_92d48476-b191-4bf8-ba9a-051b049d68e8/reload/0.log" Jul 06 20:34:18.005432 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:18.005401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-58d788f4fb-vjvp6_92d48476-b191-4bf8-ba9a-051b049d68e8/kube-rbac-proxy/0.log" Jul 06 20:34:19.117681 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.117631 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr"] Jul 06 20:34:19.118224 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118201 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56c2def-d849-4e9e-b28e-f5a620896904" containerName="cleanup" Jul 06 20:34:19.118224 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118224 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56c2def-d849-4e9e-b28e-f5a620896904" containerName="cleanup" Jul 06 20:34:19.118380 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118237 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb4a1599-66b6-4260-a5b7-23faa6e28e73" containerName="maas-api" Jul 06 20:34:19.118380 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118244 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb4a1599-66b6-4260-a5b7-23faa6e28e73" containerName="maas-api" Jul 06 20:34:19.118380 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118273 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73cd54ed-0bb9-4c2f-801d-b2602a5f4785" containerName="cleanup" Jul 06 20:34:19.118380 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118284 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="73cd54ed-0bb9-4c2f-801d-b2602a5f4785" containerName="cleanup" Jul 06 20:34:19.118380 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118292 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f10c5ccd-2fb3-4b1d-aea9-66812d147aca" containerName="cleanup" Jul 06 20:34:19.118380 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118301 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f10c5ccd-2fb3-4b1d-aea9-66812d147aca" containerName="cleanup" Jul 06 20:34:19.118573 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118403 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c56c2def-d849-4e9e-b28e-f5a620896904" containerName="cleanup" Jul 06 20:34:19.118573 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118413 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb4a1599-66b6-4260-a5b7-23faa6e28e73" containerName="maas-api" Jul 06 20:34:19.118573 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118421 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f10c5ccd-2fb3-4b1d-aea9-66812d147aca" containerName="cleanup" Jul 06 20:34:19.118573 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.118428 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="73cd54ed-0bb9-4c2f-801d-b2602a5f4785" containerName="cleanup" Jul 06 20:34:19.121736 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.121720 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.124394 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.124368 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-282xb\"/\"openshift-service-ca.crt\"" Jul 06 20:34:19.125455 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.125434 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-282xb\"/\"default-dockercfg-vsdcj\"" Jul 06 20:34:19.125624 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.125574 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-282xb\"/\"kube-root-ca.crt\"" Jul 06 20:34:19.138940 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.138916 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr"] Jul 06 20:34:19.164487 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.164456 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-sys\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.164615 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.164502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flwd9\" (UniqueName: \"kubernetes.io/projected/f58e9d99-a340-4817-a217-def9e61c529d-kube-api-access-flwd9\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.164615 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.164578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-proc\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.164724 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.164711 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-lib-modules\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.164760 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.164733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-podres\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.265888 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.265854 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-lib-modules\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.265888 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.265890 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-podres\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.266089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.265911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-sys\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.266089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.265952 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwd9\" (UniqueName: \"kubernetes.io/projected/f58e9d99-a340-4817-a217-def9e61c529d-kube-api-access-flwd9\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.266089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.265998 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-proc\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.266089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.266039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-podres\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.266089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.266039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-lib-modules\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.266089 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.266067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-sys\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.266272 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.266098 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f58e9d99-a340-4817-a217-def9e61c529d-proc\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.274346 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.274319 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flwd9\" (UniqueName: \"kubernetes.io/projected/f58e9d99-a340-4817-a217-def9e61c529d-kube-api-access-flwd9\") pod \"perf-node-gather-daemonset-x7hsr\" (UID: \"f58e9d99-a340-4817-a217-def9e61c529d\") " pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.348228 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.348196 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-9qjlv_adabb4c7-ecfe-4204-bace-10996203e1f1/networking-console-plugin/0.log" Jul 06 20:34:19.431801 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.431774 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.573379 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.573356 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr"] Jul 06 20:34:19.575434 ip-10-0-135-185 kubenswrapper[2558]: W0706 20:34:19.575410 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf58e9d99_a340_4817_a217_def9e61c529d.slice/crio-ffd7dac42b4a1b6147651c6d643e416786be3461a037346688b3577e40144665 WatchSource:0}: Error finding container ffd7dac42b4a1b6147651c6d643e416786be3461a037346688b3577e40144665: Status 404 returned error can't find the container with id ffd7dac42b4a1b6147651c6d643e416786be3461a037346688b3577e40144665 Jul 06 20:34:19.684424 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.684359 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" event={"ID":"f58e9d99-a340-4817-a217-def9e61c529d","Type":"ContainerStarted","Data":"d896ca991418af201418414214ff5118948314084528d0456bd87187e9c892d1"} Jul 06 20:34:19.684424 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.684416 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" event={"ID":"f58e9d99-a340-4817-a217-def9e61c529d","Type":"ContainerStarted","Data":"ffd7dac42b4a1b6147651c6d643e416786be3461a037346688b3577e40144665"} Jul 06 20:34:19.684601 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.684466 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:19.702521 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.702471 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" podStartSLOduration=0.702455707 podStartE2EDuration="702.455707ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:34:19.700882124 +0000 UTC m=+2642.971636425" watchObservedRunningTime="2026-07-06 20:34:19.702455707 +0000 UTC m=+2642.973210008" Jul 06 20:34:19.906605 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.906574 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/2.log" Jul 06 20:34:19.910420 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:19.910401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-nnvn2_895d20fb-5c6e-42e3-a9e8-9607be369c02/console-operator/3.log" Jul 06 20:34:20.356839 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:20.356807 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8767cd97f-rmdtg_0791277d-0f2d-49d9-a4c2-3be0c42a18e8/console/0.log" Jul 06 20:34:20.959572 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:20.959541 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hmgck_856d23cb-62b2-4d6e-bcdc-644be7044193/volume-data-source-validator/0.log" Jul 06 20:34:21.988852 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:21.988820 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b9x86_b82780f1-a844-499d-940a-af73bda34e50/dns/0.log" Jul 06 20:34:22.019106 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:22.019070 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b9x86_b82780f1-a844-499d-940a-af73bda34e50/kube-rbac-proxy/0.log" Jul 06 20:34:22.214097 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:22.214068 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzcpb_a795b245-ceba-469b-b542-be1f1c8d074f/dns-node-resolver/0.log" Jul 06 20:34:22.797697 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:22.797667 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5468s_89ade938-bfc4-413e-a75b-60e8c08c3c68/node-ca/0.log" Jul 06 20:34:23.733252 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:23.733218 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47vbks_79ee5e1d-3bf0-4f48-bd89-041fca088e36/istio-proxy/0.log" Jul 06 20:34:23.853949 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:23.853908 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rgkzn_4487d4f8-372a-42f4-a52f-cfe308214660/discovery/0.log" Jul 06 20:34:23.877581 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:23.877555 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-9cfx8_e7dcd51a-a418-41d2-bfd1-23715b6cc122/kube-auth-proxy/0.log" Jul 06 20:34:23.935380 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:23.935351 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bznwm_67011710-a339-4f0d-949b-eb210557c3d1/istio-proxy/0.log" Jul 06 20:34:23.962178 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:23.962150 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bznwm_67011710-a339-4f0d-949b-eb210557c3d1/istio-proxy/1.log" Jul 06 20:34:24.039066 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:24.038988 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbhhg_40191def-f8c8-4bc3-b005-b666b02c837f/payload-processing/0.log" Jul 06 20:34:24.709526 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:24.709497 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5shln_90fab817-e894-4238-ba9a-d1bbb9e27fd9/serve-healthcheck-canary/0.log" Jul 06 20:34:25.247136 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:25.247106 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-s48wt_dd4d6d2f-6ab3-4526-860b-96f00868dd9d/insights-operator/0.log" Jul 06 20:34:25.248378 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:25.248362 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-s48wt_dd4d6d2f-6ab3-4526-860b-96f00868dd9d/insights-operator/1.log" Jul 06 20:34:25.418329 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:25.418299 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsxm6_47ee727d-d64c-45f8-b88d-768f4b9d200a/kube-rbac-proxy/0.log" Jul 06 20:34:25.440609 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:25.440580 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsxm6_47ee727d-d64c-45f8-b88d-768f4b9d200a/exporter/0.log" Jul 06 20:34:25.466841 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:25.464530 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nsxm6_47ee727d-d64c-45f8-b88d-768f4b9d200a/extractor/0.log" Jul 06 20:34:25.700005 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:25.699977 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-282xb/perf-node-gather-daemonset-x7hsr" Jul 06 20:34:27.842216 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:27.842185 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69c479884b-bdm5q_9cb18cc1-c473-4810-96aa-59d4a3690a62/maas-api/0.log" Jul 06 20:34:27.868841 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:27.868810 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722815-prbrb_3ba53ae0-ac7e-452a-b4d9-7d8ca3709bc0/cleanup/0.log" Jul 06 20:34:27.894707 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:27.894671 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722830-mz7nb_f10c5ccd-2fb3-4b1d-aea9-66812d147aca/cleanup/0.log" Jul 06 20:34:27.995703 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:27.995672 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-666975db4c-d8gz2_7d66c9a2-f9aa-43d2-8634-f136d382db90/manager/0.log" Jul 06 20:34:28.403099 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:28.403075 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-zzwnf_1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a/manager/0.log" Jul 06 20:34:28.428381 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:28.428356 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-87fbc8964-zzwnf_1ea3fa16-40c0-43dc-9f59-fe0ab9dfbd8a/copy-manifests/0.log" Jul 06 20:34:28.455991 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:28.455962 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mcsxz_729ad934-98e2-4ac5-8f49-7b6fe9d7a9ec/postgres/0.log" Jul 06 20:34:29.722351 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:29.722317 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47vbks_79ee5e1d-3bf0-4f48-bd89-041fca088e36/istio-proxy/0.log" Jul 06 20:34:29.827852 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:29.827816 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rgkzn_4487d4f8-372a-42f4-a52f-cfe308214660/discovery/0.log" Jul 06 20:34:29.838988 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:29.838960 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-9cfx8_e7dcd51a-a418-41d2-bfd1-23715b6cc122/kube-auth-proxy/0.log" Jul 06 20:34:29.872278 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:29.872246 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bznwm_67011710-a339-4f0d-949b-eb210557c3d1/istio-proxy/0.log" Jul 06 20:34:29.899446 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:29.899417 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bznwm_67011710-a339-4f0d-949b-eb210557c3d1/istio-proxy/1.log" Jul 06 20:34:29.915054 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:29.915027 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gtqnw_0bd7a6f6-3fd3-4b36-897b-4e8e8298d480/openshift-lws-operator/0.log" Jul 06 20:34:29.958345 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:29.958312 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbhhg_40191def-f8c8-4bc3-b005-b666b02c837f/payload-processing/0.log" Jul 06 20:34:31.249348 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:31.249317 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf47vbks_79ee5e1d-3bf0-4f48-bd89-041fca088e36/istio-proxy/0.log" Jul 06 20:34:31.368800 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:31.368714 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-rgkzn_4487d4f8-372a-42f4-a52f-cfe308214660/discovery/0.log" Jul 06 20:34:31.384624 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:31.384600 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-64889d44f9-9cfx8_e7dcd51a-a418-41d2-bfd1-23715b6cc122/kube-auth-proxy/0.log" Jul 06 20:34:31.419969 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:31.419943 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bznwm_67011710-a339-4f0d-949b-eb210557c3d1/istio-proxy/0.log" Jul 06 20:34:31.447347 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:31.447314 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-bznwm_67011710-a339-4f0d-949b-eb210557c3d1/istio-proxy/1.log" Jul 06 20:34:31.522736 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:31.522701 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-xbhhg_40191def-f8c8-4bc3-b005-b666b02c837f/payload-processing/0.log" Jul 06 20:34:34.860448 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:34.860416 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bplqt_fa8a8447-8549-4909-b062-e1d66418e955/migrator/0.log" Jul 06 20:34:34.900873 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:34.900843 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bplqt_fa8a8447-8549-4909-b062-e1d66418e955/graceful-termination/0.log" Jul 06 20:34:35.286159 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:35.286126 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ndn9c_a136fc5b-adc8-4f0f-9fb3-5e02aaca810e/kube-storage-version-migrator-operator/1.log" Jul 06 20:34:35.287107 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:35.287087 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-ndn9c_a136fc5b-adc8-4f0f-9fb3-5e02aaca810e/kube-storage-version-migrator-operator/0.log" Jul 06 20:34:36.248097 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.248067 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7vm2d_9eb3ad55-8b96-4f37-a8bd-e3c67a9dfa37/kube-multus/0.log" Jul 06 20:34:36.630861 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.630785 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjpdf_005f5b5c-aac6-49fa-b472-c45f523b7846/kube-multus-additional-cni-plugins/0.log" Jul 06 20:34:36.655841 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.655817 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjpdf_005f5b5c-aac6-49fa-b472-c45f523b7846/egress-router-binary-copy/0.log" Jul 06 20:34:36.681481 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.681455 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjpdf_005f5b5c-aac6-49fa-b472-c45f523b7846/cni-plugins/0.log" Jul 06 20:34:36.703757 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.703732 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjpdf_005f5b5c-aac6-49fa-b472-c45f523b7846/bond-cni-plugin/0.log" Jul 06 20:34:36.727024 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.727001 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjpdf_005f5b5c-aac6-49fa-b472-c45f523b7846/routeoverride-cni/0.log" Jul 06 20:34:36.750167 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.750137 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjpdf_005f5b5c-aac6-49fa-b472-c45f523b7846/whereabouts-cni-bincopy/0.log" Jul 06 20:34:36.772727 ip-10-0-135-185 kubenswrapper[2558]: I0706 20:34:36.772698 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gjpdf_005f5b5c-aac6-49fa-b472-c45f523b7846/whereabouts-cni/0.log"